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Description 



1 . Field of the Invention 
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[0001] The present invention relates to object extraction method and apparatus for extracting a specific image from 
color images or black-and-white images. Further present invention relates to color-image recognition method and ap- 
paratus for detennining whether the thus-extracted specific image is an image from given images. In practice, such a 
specific-image extraction is performed as follows: Data representing a specific Image is extracted from data represent- 
ing color images or black-and-white images. Further, data representing a specific image part is extracted from data 
representing a specific color image or a black-and-white Image. 

[0002] Each of the color-image recognition method and apparatus uses the thus-extracted specific image and then 
determines whether the specific image con-esponds to an image included in given images, which are, for example, 
Images constituting an image database, in particular, color-image database. 

[0003] , in an example, such a technique may be applied to works in a police office. The police office may have a 
database of criminals' face photographs. When a montage picture (composite picture) is given by a witness, the police 
officer attempts to detemnine whether the image of thus-given picture is an image included In the database. 
[0004] In another example, an intelligent building may use such a technique. A microcomputer Is provided inside a 
door of a room of a firm and the microcomputer uses a database of employees' face photographs. If a percon comes 
in front of the door, the microcomputer uses a CCD camera to take image data of the person's face and, by using the 
thus-taken Image data, the microcomputer attempts to detemnine whether the same image data is included in the 
database. If the microcomputer has succeeded In detemiining the same Image data Is in the employees' face database, 
the microcomputer opens the door for the person and if not, the microcomputer does not open it. Thus, no real key Is 
needed for the door. 

[0005] In another example, such a technique may be used to prevent bank notes and securities from being replicated. 
A duplicator may have image data of bank notes and securities and if an operator sets an original image on the duplicator 
to obtain a copy thereof, the duplicator checks If data of the thus-set original Image is Included in the image data of 
bank notes and securities. 



30 



35 



40 



45 



50 



55 



2. Prior Art 

[0006] Apparatuses processing color images such as a color duplicator, a color printer, a color scanner, a color- 
Image communication apparatus, and so forth are expected to be further developed in the future. It has become easier 
to handle the color images by hardware development, such as cost reductions and capacity increase of various sorts 
of memories, data-communication cost reduction and so forth. However, since data representing the color images has 
a huge data amount (for example. 96 Mbytes for an image of the A3 size) it is impossible to handle the color Images 
similarly to handling data representing two-tone images. 

[0007] In particular in handling image data, a complicates process such as Image recognition (such as recognition 
of a specific image. OCR or the like) requires a huge amount of data to be processed. Therefore, it Is further difficult 
to realize the image recognition for the color Images. 

[0008] Various methods have been proposed as an object extraction method for extracting an object to be recognized. 
In an example method, the method extracts black-continuity rectangles from a relevant image and compares values 
representing the thus-extracted rectangles with predetemiined threshold values. The method classifies the rectangles 
into -rectangles representing characters and rectangles representing line drawings. See Japanese Laid-Open Patent 
Application No.55-162177. However, this method neither classifies the thus-classified rectangles of line drawings Into 
rectangles representing horizontal ruled-lines, nor has a capability to extract a specific image even if the relevant imaqe 
is present but is in a rotated fonn. 

[0009] As an apparatus and method for identifying a specifib color image, a color-image processing apparatus (see 
Japanese Lald-Open Patent Application No.4-54681) was proposed, which apparatus extracts hue and distribution of 
the hue from a given region of an original image and thus detects whether or not a specific image is present However 
the above-described apparatus uses only 32 points to be sampled, the number of points to be sampled being a few in 
order to reduce a data amount to be processed. Such using of a few sampled points may not result in obtaining a 
sufficient amount of infomiation required to extract characteristics of a relevant image. Therefore, it is not possible to 
obtain highly accurate image identification perfonnance. 

[001 0] Further, a method was proposed for determining whether or not a specific color appears and then extracting 
image parts having the same characteristics (see Japanese Laid Open Patent Application No.4-1 80348) Each of 
patterns constituting an image has a particular stretch in a color space. The above-mentioned method uses such 
specific stretches, in the color space, of the pattems to identify a certain image part as being a specific Image part the 
certain image part having specific stretches in the color space the same as those of the specific image part However. 
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the method cannot distinguish image parts having the same stretch in the color space but a different color distribution 
inside the stretch. Thus, if a certain image part has a stretch in the color space, which stretch is the same as the stretch 
of a specific image part, but a color distribution inside the stretch is different from that of the stretch of the specific 
image part, the method may erroneously identify the certain image part as being the specific Image part. 

5 [0011] Document EP-A-0 294 497 discloses a postage stamp identifying apparatus extracting color characteristic 
patterns of the stamp as a feature vector from a stamp, and the detected color characteristic pattern of the stamp is 
compared with each of standard color characteristic patterns prepared before-hand for known stamps. 
[0012] An object of the present invention is to provide a color image recognition method and apparatus, each of 
which extracts an innage region corresponding to an object from an input image with high accuracy. 

10 [0013] Another object of the present invention is to provide color-image recognition methods and apparatus, each 
of which method and apparatus extracts an object from an input image and perfonns a color-image recognition operation 
on the object. Each of the color-image recognition method and apparatus obtains a sufficient amount of information 
required for the color-image recognition operation so that high-accuracy color-image recognition can be achieved with 
a data amount to be processed being compressed. 

15 [0014] Another object of the present invention is to provide color-image recognition methods and apparatus, each 
of which method and apparatus uses a table-conversion manner to convert relevant data, instead of perfonming a 
calculation operation, so as to compress the amount of the relevant data. Thus, it is possible to achieve an effective 
data-amount compression. 

[0015] Another object of the present invention is to provide color-image recognition methods and apparatus, each 
20 of which method and apparatus suppresses an adverse effect of noise image Information. The noise image infomnation 
may be included in relevant Information as a result of, for example, an image scanner reading in information of not 
only a relevant image printed on a relevant sheet but also of another image which is printed on another sheet subsequent 
to the relevant sheet. The image of the subsequent sheet may be read by the scanner through the relevant sheet if it 
is thin. Each of the method and apparatus perf omns a vector quantizing operation only on the relevant image Infomnation, 
25 Thus, image-recognition capability and data processing speed are improved. 

[0016] Another object of the present invention is to provide color-image recognition methods and apparatus, each 
of which method and apparatus determines a similarity between information of an input Image and information of a 
predetemnlned code book infomiatlon. If the thus-determined similarity is higher than a predetermined threshold value, 
no vector-quantizing value is assigned to the information of the input image. Thus, image-recognition capability and 
30 data processing speed are improved. 

[0017] Color image recognition methods and apparatus are provided according to the invention as set out in claims 
1 and 12, respectively. 

[0018] To achieve the above-mentioned objects, color image recognition methods and apparatus according to the 
present invention determine a circumscribing rectangle for a black continuous image part using a two-tone image 

35 signal. A height and a horizontal length of the rectangle are then compared with threshold values. If an operator specifies 
that an object to be extracted from an input image has a rectangular shape, whether or not the relevant image part is 
possibly one which is obtained as a result of rotating the object is determined. If it is determined that the Image part is 
possibly one which is obtained as a result of rotating the object, under an assumption that the image part also has a 
rectangular shape, lengths of sides of the image part are compared with threshold values. If it is detemnlned that the 

40 image part Is not one which is obtained as a result of rotating the object, the height and horizontal length of the cir- 
cumscribing rectangle is the threshold values. Thus, It Is detennined whether or not the image part Is identical to the 
object. 

[0019] Further, each of color image recognition methods and apparatus according to the present Invention divides 
an input image into small regions, An RGB (red, green and blue) chromaticity histogram is produced for each of the 

45 small regions. Each of the chromaticity histograms of the small regions is compared with reference ones, named code 
book infomnation, previously produced and stored. Each of the thus-stored reference chromaticity histograms has an 
identification number. As a result of the comparison, the identification number of the histogram having the highest 
similarity to that of the small region among those constituting the Input image is given to the small region. A histogram 
of the identif Nation numbers thus given to the small regions constituting the input image Is produced. The thus-produced 

50 histogram is compared with reference ones, named dictionary Information, previously produced and stored. As a result 
of the comparison, a reference histogram of identification numbers among the thus-stored reference ones is selected, 
the thus-selected one having the highest similarity to that of the input Image. Each of the above-mentioned reference 
histograms of identification numbers corresponds to a respective one of a plurality of objects. As a result of the above- 
mentioned selection, one of the plurality of objects is detemiined to be identical to the input image. Thus, the input 

55 image Is recognized. 

[0020] Other objects and further features of the present invention will become more apparent from the following 
detailed description when read in conjunction with the accompanying drawings. 
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FIG.1 shows a block diagram of a first embodiment of a color image recognition method and apparatus according 
to the present invention; 

FIG.2 shows an operation flow chart of the above-mentioned embodiment shown in FIG.1 ; 
FIG. 3 Illustrates a method of recognizing a location of a circumscribing rectangle and a location of an image part 
circumscribed by the circumscribing rectangle, the method being perfomied by a rectangle extracting unit in the 
embodiment shown in FIG.1 ; 

FIG.4 Illustrates a method of detenninrng whether or not the relevant image part is possibly one obtained as a 
result of rotating an object, the method being perfomied by a rotation detemiining unit in the embodiment shown 
In FIG.1; 

FIG.5 show a block diagrams of second, third and fourth embodiments of the color image recognition method and 
apparatus according to the present invention; 

FiGS.6 and 7 show block diagrams of a fifth embodiment of the color image recognition method and apparatus 
according to the present invention; 

FIG.8 illustrates a method of dividing an Input Image part Into small regions, the method being performed by a 
mesh dividing unit in the embodiment shown in FIG.7; 

FIGS.9 and 10 illustrate a vector quantizing operation perfomied by a vector quantizing executing unit shown in 
FIG.7; 

FIGS.11 A and 11 B shows an operation flow of the embodiments shown In FIGS,6 and 7; 

FIG.12 Illustrates a scope defining operation performed through a step S203 shown in FIG.11 B; 

FIG.13 shows an object Identifying operation performed through a step S205 shown in FIG.11 B; 

FIG.14 shows a block diagram of a sixth embodiment of color image recognition method and apparatus according 

to the present Invention; 

FIG.1 5 shows an operation flow of the embodiment shown in FIG.14; 

FIG. 1 6 illustrates a pixel selecting operation which is a feature of a seventh embodiment a color image recognition 
method and apparatus according to the present invention; 

FIG. 1 7 shows an operation flow of ninth and tenth embodiments of a color image recognition method and apparatus 
according to the present invention; 

FIG,18 shows a block diagram an eleventh embodiment of a color image recognition method and apparatus ac- 
cording to the present invention; 

FIG.1 9 illustrates a conversion compressing operation performed by a characteristic extracting unit 37B using a 
conversion compressing table 50 shown in FIG.1 8; and 

FIG.20 Illustrates a vector quantizing operation perfomied by a vector quantizing unit 38 shown in FIG.1 8. 

[0021] With reference to FIG.1, an object extraction system in a first embodiment of the color image recognition 
methods and apparatus according to the present invention will now be described. In general, the system is effective 
In the use of an image having a rectangular outline as the object, an image part corresponding to the object being 
extracted through the system. That is, the system Is produced generally based on an assumption that said Image part 
has a rectangular shape. Accordingly, names of units in the system and associated expressions may be those based 
on the object having a rectangular outline. However, the system can use a figure other than a rectangle as the object 
A two-tone Image signal generating unit 1 generates two-tone image signal using an input image. A circumscribing 
rectangle extracting unit 2 extracts circumscribing rectangles from the thus-generated two-tone image signal. 
[0022] Hereinafter, to extract a circumscribing rectangle means to obtain a circumscribing rectangle described below 
The circumscribing rectangle Is a rectangle, two of four sides of which extend along a scan-line direction in which the 
input Image Is scanned so as to be read In. The circumscribing rectangle is extracted for a black-continuity image part 
present in an Image represented by the two-tone image signal. The black-continuity image parts consists of black 
pixels constituting a black continuous region in the image. The circumscribing rectangle is a rectangle which circum- 
scribes the relevant black-continuity image part. 

[0023] A rectangle memory 3 stores rectangle data representing the thus-extracted circumscribing rectangle. A can- 
didate-rectangle detemiining unit 4 which uses the thus-stored circumscribing rectangle data and then compares a 
horizontal length and a height of each of the circumscribing rectangles with first preset threshold values (representing 
first preset extents for the object). The first preset extents are an extent in height and an extent in horizontal dimension 
Thus, the detenmining unit 4 determines whether or not each circumscribing rectangle might be possibly correspond 
to an object which is a black-continuity Image part to be extracted from the image. Further, the candidate-rectangle 
determining unit 4 determines whether or not a shape of the object is a rectangle. 

[0024] If the candidate-rectangle determining unit 4 has detennined the circumscribing rectangle to possibly be the 
object, a candidate-rectangle memory 5 stores candidate-rectangle data representing the thus-detennlned circum- 
scribing rectangle which will be refen-ed to as a candidate rectangle. 

[0025] A rotation detemiining unit 6. if the candidate-rectangle determining unit 4 has determined the shape of the 
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object is a rectangle, further checks the candidate rectangle. The rotation determining unit 6 determines whether or 
not the relevant candidate rectangle may possibly include the object therein and the relevant image part Is possibly 
one which was obtained as a result of rotating the object. 

[0026] A side-length measuring unit 7 measures a length of a longer side and a length of the shorter side of the 

5 relevant biack-contlnuity image part. An object determining unit 8 compares the thus-measured lengths with second 
preset threshold values (representing second preset extent for the object) so as to determine whether or not the can- 
didate rectangle con-esponds to the object. The second preset extents are an extent in height and an extent in horizontal 
dimension. The second preset extents for the object are nan-ower than the above-mentioned first preset extents for 
the object, respectively. By using the first and second preset extents forthe object, it Is possible to step by step determine 

10 the possibility of the relevant image part corresponding to the object. Thus, using the first extents for the object, if the 
relevant image part actually corresponds to the object but the image part is one which is obtained as a result of rotating 
the object, failing to extract the image part can be prevented since the first extents for the object are relatively wide 
respectively. Using the relatively narrow second extents for the object, it is possible to accurately detennine the cor- 
respondence between the relevant image part and the object. An object-rectangle memory 9 stores data representing 

IS the outline of the relevant Image part if the candidate rectangle has been detemiined to correspond to the object through 
the object detennining unit 8. A control unit 10 controls the units 2, 4, 6, 7 and 8 in the system. 
[0027] With reference to FiG.2, an operation flow charts of the object extraction system shown in FIG.1 will now be 
described. A step S101 generates the two-tone image signal using the input Image through the two-tone image signal 
generating unit 1 . Specifically, for example, the input image may be input in a form of a multi-tone image black-and- 

20 white signal, and the unit 1 may have a predetemnined threshold value. The unit 1 uses the predetermined threshold 
value and thus obtains the two-tone image signal. 

[0028] That is, if a value of a pixel represented by the multi-tone image signal is equal or less than the threshold 
value, the value is determined to be a black pixel and if the value of the pixel is greater than the threshold value, the 
pixel is detennined to be a white pixel. 

25 [0029] A step SI 02 extracts the circumscribing rectangle from the two-tone image signal through the rectangle ex- 
tracting unit 2. Any one of methods proposed by the present applicant through Japanese Laid-Open Patent Applications 
Nos.3-341 889, 4-267313, 4-160866 and so forth may be used forthe circumscriblng-rectangle extraction. 
[0030] FiG.3 shows a circumscribing rectangle 202, as an example, extracted from the Input image 201 . The cir- 
cumscribing rectangle 202 is that extracted for the black-continuity image part 203. According to the first embodiment, 

30 in the step SI 02, coordinates (Xg, yg), (Xg, y^), (Xg, yg) and (x^, y^) of four vertexes of the rectangle 202 are extracted. 
Further, simultaneously to the vertex-coordinate extraction, coordinates (x^, y^), (x^, y^), (Xg, y,) and (Xj,, y©) for points 
at which the circumscribing rectangle comes into contact with the black-continuity image part are extracted. 
[0031] The above description has been made based on the image part 203 being a rectangle. However if the image 
part 203 is not a rectangle, a similar method may be applied. That is, if the Image part 203 is any figure, a number of 

35 points are present at which the image part comes into contact with the circumscribing rectangle. The step S102 may 
obtain coordinates of the number of points and data of the thus-obtained coordinates may be used in the subsequent 
steps similarly to those obtained in the case where the image part 203 Is a rectangle. An essential point Is that if the 
object is present in the input image part, it should be accurately extracted. Thus, which figure the relevant image part 
203 is, is not an essential point, but It is essential that comparison between reference data associated with the object 

40 and data associated with the relevant image part 203 should be accurately perfonned. Such accurate comparison is 
achieved as a result of ensuring that how the reference data associated with the object was obtained is the same as 
how the data, to be compared with the reference data., associated with the image part 203 is obtained. The above- 
described method for obtaining infomiation indicating the position of the outline of the circumscribing rectangles and 
that of the image parts is a method what is simple yet enables an effective position recognition. 

45 [0032] A step SI 03 determines whether or not the height and the horizontal length of the circumscribing rectangle 
are in the first preset extents for the object through the candidate-rectangle detennining unit 4. That is, the step 8103 
determines whether or not the height is present between a i'elevant preset maximum allowable limit and a minimum 
allowable limit and similarly determines whether or not the horizontal length is present between a relevant preset 
maximum allowable limit and a minimum allowable limit. If at least one of the height and horizontal length is not present 

so within the relevant extent, a step S1 1 6 determines that the relevant image part does not correspond to the object. One 
of the above-mentioned methods proposed by the present applicant may be used for the dimension-using object- 
candidate detemnining operation performed by the step SI 03. A step S104 determines whether or not the shape of 
the object Is a rectangle through the candidate-rectangle detennining unit 4. Whether or not the shape of the object is 
a rectangle is, for example, previously input by an operator and the thus-input data is preset in the candidate-rectangle 

S5 determining unit 4 before the above-described object extracting operation is actually perfonned. It is noted that deter- 
mining in SI 04 whether or not the shape of the object is a rectangle is performed based on information from the outside 
of the system, but not based on a result of the system's checking the actually input image signal. 
[0033] If the step SI 04 has detennined that the object shape is a rectangle, a step SI 05 detennines whether or not 
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a rotation angle Is present between the relevant image part and the scan-line direction through the rotation determining 
unit 6. FIG.4 shows a candidate rectangle 301 for an image part 302 as an example. The rotation determination is 
perfomied in the following manner: If the image part 302 is a rectangle as shown in FIG.4, It is determined whether or 
not a triangle A is congruent with a triangle B and also it is detemiined whether or not a triangle C is congruent with a 
tnangle D, shown in FIG.4. If at least one of the above-mentioned two congruities is not admitted in the rotation deter- 
mination, It IS detemiined that the relevant image part Is not one which was obtained as a result of rotating the object 
If each of the above-mentioned two congruities Is admitted in the rotation detemiination, it is determined that the 
relevant image part Is possibly one which was obtained as a result of rotating the object. Further, if the above-mentioned 
coordinates (x,. y,), (x,, y,), (x„ yj and (x,, y,) of thefourvertexes of the rectangle 202 are coincide with thecoordinates 
(Xu. Vs) (Xe. Vr). (Xg yO and (x^, Ve) of the points at which the circumscribing rectangle comes into contact with the black- 
continuity image part are extracted, respectively. It Is detemiined that the relevant image part is not one which was 
obtained as a result of rotating the object. 

'°°-oL ^ '^"^"^ ^ '^'^3°"^' ® compared with a length of the other diagonal line D2 of the image 

part 302 as shown in FIG.4. Each length of thelengths of the diagonal lines D1 and D2 Is calculatedfrom thecoordinates 
such as (Xu, ys), (x,, y,), (x,, y,) and (xt, y^), shown in FIG.3, of the rectangle data obtained for the Image part 302 by 
he step S1 02. As a result of the above-mentioned length comparison, if a difference between the lengths of the diagonal 
lines D1 and D2 is relatively long. It is detemiined that the relevant image part has a shape of a diamond and not of a 
rectangle, thus the image part 302 is not one obtained as a result of rotating the object. Such a method for determining 
he rotation of the object using the congmency of the triangles is a method simple but enabling effective rotation de- 
termination. 

(0035] if the step 81 05 has detemiined that the image part is possibly one obtained as a result of rotating the object 
a step SI 06, through the side-length measuring unit 7, calculates a length s1 of a first side and a length s2 of a second 
side adjoining the first side of the image part 302 and shown In FIG.4. The length calculation is perfomied using the 
coordinates, such as (x„, y^, (x„ y,), (x^, y,) and (x,, y,) shown in FIG.3, of the rectangle data obtained for the linage 
part 302 by the step SI 02. The step 8106 then determines the thus-calculated lengths as lengths of a short side and 
a long side of the relevant image part. However, if the step 8104 has determined that the shape of the object is not a 
rectangle, the step 81 07 detemnines that the height and horizontal length of the circumscribing rectangle are the lengths 
of the short side and long side of the Image part. Further, if the step 8105 has detemiined that the image part is not 
one obtained as a result of rotating the object, the step 81 07 determines that the height and horizontal length of the 
circumscnbing rectangle are the lengths of the short side and long side of the image part. 

[0036] A step SI 08 determines whether or not the thus-determined lengths of the short side and long side of the 
image part are in the second preset extents for the object through the object determining unit 8. That is the step SI 08 
determines whether or not the short-side length is present between a relevant preset maximum allow^le limit and a 
minimum allowable limit and similarly detemiines whether or not the long-side length is present between a relevant 
preset maximum allowable limit and a minimum allowable limit. If at least one of the short-side and long-side lenqths 
IS not present within the relevant extent, a step 81 16 detemilnes that the relevant image part does not correspond to 
the object. If the short-side and long-side lengths are present within the relevant extents, respectively, the step S115 
determines that the relevant image part conesponds to the object. The above-described operation flow shown in FIG 
2 will be perfomied on all the black-continuity image parts included in the input image in the fomi of the two-tone image 
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[0037] The detemiination perfomied in the step 8104 Is based on, for example, the operator's input as mentioned 
above. Therefore, whether or not the two-tone image signal obtained in the step 8101 corresponds to a rectangle 
depends on cases. That is, as one case, it is assumed thai the object to be extracted is a rertangular business card 
which IS made of a small white paper sheet having black letters printed thereon. In such a case, the operator may 
determine the object as being a rectangle and thus inputs inforniadon. indicating the object as being a rectangle into 
he candidate-rectangle determining unit 4. Then, if the identteai business card is used as an image part to be checked 
through the object extraction system shown in FIG.1 , the two-tone Image signal generating unit 1 generates the signal 
representing the black letters printed on the white paper sheet, but does not generate that representing the white paper 
sheet, in the step 8101. As a result, the step 8102 extracts the rectangles of the black letters 
so [0038] In one typical rectangle extraction method, one rectangle is extracted for each black letter and thus a com- 
bination of the rectangles for the black letters is obtained through the step SI 01 , a general overall outline the above- 
mentioned combination does not ordinary have a rectangular shape. As a result, the shape of the image part is deter- 
mined as not being a rectangle. However, the step 8104 determines the object as being a rectangle-according to the 
above-mentioned operator's input. In such a case, the step 81 04 detemilnes YES and the step 31 05 determines NO 
This is because the above-mentioned triangle congrulty described with reference to FIG.4 is not admitted in the rotation 
determination as a result of the relevant image part (302 in FIG.4) being the combination of the rectangles and the 
combination having general overall outline not being a rectangular shape as mentioned above. Whether or not the 
relevant image part is present as one resulting from being rotated, the triangle congrulty is not admitted, unless the 
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relevant image part has a general overall outline being a rectangular shape. In fact, If the relevant image part has not 
a rectangular overall outline, a shape of each of areas present defined by a part of a border of the circumscribing 
rectangle and a part of the outline of the relevant image part does not constitute a triangle. In such a case, the step 
SI 07 is executed after the step S105. Thus, the step S107 is performed correctly for the relevant image part not a 

5 rectangle in this case although the step SI 04 determines the object as being the rectangle. In such a case, the above- 
mentioned second preset extents for the object were predetemiined so as to match the black letters of the business 
card. A longer one of a height and a horizontal length of the combination of the rectangles for black letters of the 
business card is used as the long-side length used in the step S108 as the reference data. Further, a shorter one of 
the height and horizontal length is used as the short-side length used therein. Thus, the relevant image part is con-ectly 

10 detennined as the object in the step S115 unless the relevant image part is one resulting from rotating the object. 
[0039] It is noted that, nonmally, each letter of such black letters of the business card may be determined as being 
an individual small black-continuity image part and thus result in an individual small circumscribing rectangle through 
the rectangle extracting unit 2. The thus-obtained small circumscribing rectangles for the black letters of the business 
card may be integrated into a single rectangle, the integration being perfomied on circumscribing rectangles which 

IS have mutual distances each distance being shorter than a predetenmlned threshold value. Thus, the above-mentioned 
combination of the rectangles for black letters of the business card can be obtained. The above-mentioned predeter- 
mined threshold value may be detennined to match geometric arrangement of letters printed in such a business card. 
Such an integrating step may be inserted in the rectangle extraction step S1 02 in a case where such letters printed on 
a business card are used as the above-mentioned object. 

20 [0040] Further, it is possible to insert, between the two-tone image signal generating unit 1 and the rectangle ex- 
tracting unit 2, an image compressing unit for converting each group of 8 pixels of the input image in the fonn of the 
two-tone image signal Into one pixel. Thus, an Image signal obtained as a result of compressing the two-tone Image 
signal Is obtained and the thus-obtained image signal is used to extract the circumscribing rectangles. 
[0041] An object extraction system In a second embodiment of object extraction method and apparatus according 

25 to the present invention will now be described. Difference between the object extraction system in the second embod- 
iment and that in the first embodiment is that the system in the second embodiment uses a color-Image signal as the 
input signal while the system In the first embodiment uses the multi-tone black-and-white-Image signal as the input 
signal as described above. Except for this point, the two systems are Identical. Specifically, the two-tone Image signal 
generating unit 1 , shown in FIG.1 , In the system in the second embodiment operates as follows: 

30 [0042] It is assumed that the input color-Image signal carries three color component reflectance values R (red), G 
(green) and B (blue) for each pixel. The reflectance values are large if the pixel is white and the reflectance values are 
small if the pixel is black. The two-tone image signal generating unit 1 derives a lightness value L using the reflectance 
values R, Q and B through the following equation: 

35 

UR+G+B 

The two-tone image signal generating unit 1 in the second embodiment detemnines each pixel as being black if 

40 

L<Jh^, 

and determines the pixel as being white if 

45 

L>Th1. 

The sign Th1 represents a predetemriined threshold value. Thus, the generating unit 1 detemiines a pixel having a 
lightness lower than the value Th1 as being black and detemnines the pixel having a lightness higher than the value 
50 as being white. The thus-detemiined color, black or white, is used as being a value carried by the two-tone signal for 
each pixel. Thus, the two-tone signal is generated. 

[0043] This method is effective for a case in which a sheet having an original image to be checked is placed in a 
white background. That is, if the system is applied to a machine such as a duplicator and the duplicator has a glass 
on which the sheet, for example the business card having color letters printed thereon in this case, is to be placed. 
55 The duplicator further has a plate which has a white surface and is placed on the glass, so that the white surface faces 
the glass, after the sheet is placed on the glass. The above-mentioned glass has, for example, a size of the A3 size 
and the white surface has a size larger than the A3 size accordingly. The duplicator scans the sheet and the white 
surface of the plate, both having been placed on the glass. As a result, the pixels con-esponding to the white surface 
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are determined as being while and the pixels corresponding to the sheet, the business card in this example are also 
detennined as being while, but the color letters printed thereon is not determined as being white. Therefore in all the 
relevant pixels, only the pixels corresponding to the color letters are used to extract the circumscribing rectangles 
through the step S102 shown in FIG.2. The pixels corresponding to the white surface are removed from those to be 
used to extract the circumscribing rectangles and thus the object extracUon operation Is simplified and can be performed 
efficiently. The above-mentioned value Thi should be detemiined so that the white surface of the plate and the white 
background of the business card Is to be determined as being white and the color letters printed on the business card 
is to be determined as being black. 

[0044] An object extraction system in a third embodiment of object extraction method and apparatus according to 
the present invention will now be described. Difference between the object extraction system in the third embodiment 
and that in the second embodiment will now be described: 

[0045] The two-tone image signal generating unit 1 in the third embodiment determines each pixel as being black if 

L>Th2. 

and detemiines the pixel as being white if 



L<Th2, 



The sign Th2 represents a predetermined threshold value. Thus, the generating unit 1 detennines a pixel having a 
lightness higher than the value Th2 as being black and determines the pixel having a lightness lower than the value 
as being white. The thus-detemiined color, black or white. Is used as being a value carried by the two-tone signal for 
each pixel. Thus, the two-tone signal is generated, 

[0046] This method is effective for a case in which a sheet having an original image to be checked is placed In a 
white background. That is. if the system is applied to a machine such as a duplicator and the duplicator has a glass 
on which the sheet, for example the business card having color letters printed thereon In this case, is to be placed 
The duplicator further has a plate which has a silver surface and is placed on the glass, so that the silver surface faces 
the glass, after the sheet Is placed on the glass. The term 'silver' means a state of the surface of the plate such that 
the pixels obtained from the surface have the reflectance values being very black. That is, the corresponding lightness 
value L is very low and thus, the silver surface is determined as being white (L<Th2). The duplicator scans the sheet 
and the silver surface of the plate, both having been placed on the glass. As a result, the pixels corresponding to the 
silver surface are determined as being white {L<Th2) and the pixels corresponding to white background of the sheet 
the business card in this example, are detemiined as being black (L^Th2). Therefore, in all the relevant pixels only 
the pixels corresponding to the white background of the business card are used In the extraction of the cirxjumscribing 
rectangles through the step S1 02 shown in FIG.2. The pixels corresponding to the silver surface are removed from 
those to be used in the extraction of the circumscribing rectangles and thus the object extraction operation is simplified 
and can be perfonned efficiently. The above-mentioned value Th2 should be determined so that the silver surface of 
the plate is to be determined as being white (L<Th2) and the white background of the business card is to be determined 
as being black (L>Th2). 

[0047] Except for this point, the two systems in the second and third embodiments are identical. 
[0048] Further the method of the system in the third embodiment is effective in a case in which the sheet to be 
checked IS place on the glass of the duplicator and no plate is placed on the glass, that is. only the sheet is placed on 
the glass. The duplicator scans the sheet having been placed on the glass and an open space present on and above 
the glass. As a result, the pixels corresponding to the open space are determined as being white (L<Th2) and the 
pixels con-esponding to white background of the sheet, the business card in this example, are determined as being 
black (I^Th2). Thus, the condition is similar to that in the case in which the silver surface of the plate is used as 
described above. 

[0049] An object extraction system in a fourth embodiment of object extraction method and apparatus according to 
the present invention will be described with reference to FIG.5. Difference between the system In the fourth embodiment 
and the systems in the second and third embodiments will now be described. 

[00501 Differently from each of the systems of the second and third embodiments, the system in the fourth embod- 
iment has the two-tone image signal generating unit //, a two-tone image signal memory A and a two-tone image 
signal memory B, as shown in FIG.5. The two-tone image signal generating unit 11 performs both a first operation 
Identical to one which the two-tone image signal generating unit 1 in the system in the second embodiment perfomis' 
and a second operation, identical to one which the two-tone image signal generating unit 1 in the system in the third 
embodiment performs. The two-tone image signal obtained from the above-mentioned first operation is stored in the 
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two-tone image signal memory A, 12 and the two-tone image signal obtained from the above-mentioned second op- 
eration is stored in the two-tone image signal memory B, 13. 

[0051] The rectangle extracting unit 2 extracts the circumscribing rectangles using the two-tone image signal stored 
in the memory 12, the thus-extracted circumscribing rectangles being referred to as first rectangles. Further, the rec- 
tangle extracting unit 2 extracts the circumscribing rectangles also using the two-tone image signal stored in the memory 
13, the thus extracted circumscribing rectangles being refenred to as second rectangles. The candidate-rectangle de- 
temiining unit 4 perfomis the step SI 03 shown in FIG.2 so as to determine for each rectangle of the first and second 
rectangles whether or not the rectangle has dimensions matching the first preset extents for the object, respectively 
As a result, a rectangle among the above-mentioned first rectangles may be detemnined to have dimensions included 
in the first preset extents respectively for the object and It will be refen-ed to as a first rectangle. Similarly, a rectangle 
among the above-mentioned second rectangles may be determined to have dimensions Included In the first preset 
extents respectively for the object and it will be referred to as a second rectangle. 

[0052] The candidate-rectangle detennining unit 4 then detemnines whether or not the first rectangle completely 
geometrically includes the second rectangle or vice versa or no such inclusion is present In the rectangles. If such 
'5 inclusion is present, only one rectangle which completely includes the other rectangle is stored in the rectangle memory 
3 and the other rectangle completely Included in the rectangle, having been stored in the memory 3 as mentioned 
above, is removed from further detemiination. If, for example, the above-mentioned second rectangle is geometrically 
completely included in the first rectangle, only the first rectangle is stored in the memory 3 and will be further detemiined. 
Such geometrical determination can eliminate redundancy which results from pertonming further determination on the 
20 two rectangles, one geometrically completely Includes the other. 

[0053] The above-described operation will now be described using the above-mentioned example using the business 
card as the input image to be checked in the object extraction system. If the duplicator having the plate with the white 
surface is used as the plate to be placed on the glass, the white surface of the plate is determined as being white in 
the two-tone image generating unit 1 1 in the first operation according to the method of the system in the second em- 
bodiment. Further, the white background of the card, placed on the glass at the same time, Is determined as being 
white and the color tetters Is detennined as being black. As a result, the /3f/sf circumscribing rectangles obtained from 
the two-tone image signal is a rectangle representing the co/or letters. On the other hand, in the second operation 
according to the method of the system In the third embodiment, the two-tone image generating unit 11 provides the 
two-tone image signal in which the white surface of the plate and the white background of the business card are 
detemnined as being black {L>Th2). As a result, the secondclrcumscribing rectangle obtained from the two-tone image 
signal Is a rectangle representing the white surface of the pfate which has dimensions, for example, of a size larger 
than the A3 size, as mentioned above. On the other hand, the first rectangle having the dimensions of the business 
card, for example, 9 cm x 5.5 cm. The thus-obtained second rectangle has very large area in comparison to the first 
rectangle. If the object to be extracted is a business card such as that placed on the glass of the duplicator as mentioned 
above, the above-mentioned first preset extents (in dimensions) for the object thus are those including the dimensions 
of the business card, respectively, accordingly. Since the dimensions of the A3 size are very large in comparison to 
those of the business card, the second rectangle will not be determined to have dimensions included in the first preset 
extents respectively for the object in the step S1 03. As a result, only the first rectangle will be detennined to have the 
dimensions Included in the first preset extents respectively for the object, and thus will be stored in the rectangle 
memory 3, and further determination will be perfomied on the thus-stored rectangle. 

[0054] In this example, if the operator does not use the plate and thus the plate is not placed on the glass, the 
duplicator scans the open space present on and above the glass and thus it is determined as being black according 
to the method of the second embodiment. Further, the color letters printed on the business card are also determined 
as being black. Thus, the ffrsf circumscribing rectangles is those representing the open space and the coior fetters of 
the business card. On the other hand, in the two-tone image signal obtained in accordance with the method according 
to the third embodiment, the open space is detennined as being white and the white background of the business card 
is determined as being black. Thus, the secoricy circumscribing rectangle Is that representing the business card. Thus, 
the three circumscribing rectangles are obtained, first one for the open space on and above the glass, second one for 
the color letters of the card and third one for the business card. As mentioned above, the candidate-rectangle deter- 
mining unit 4 detemiines that each of the second one for the color letters of the card and the third one for the business 
card among the three circumscribing rectangles are included in the first preset extents respectively for the object. This 
is because the circumscribing rectangle for the open space has dimensions similar to the white surface of the plate 
and very large in comparison to the those of the business card. Further, the circumscribing rectangle for the color letters 
of the card has dimensions relatively close to those of the business card since, generally speaking, an overall outline 
of a set of letters printed on the business card has a major area In the entire area of the business card. As mentioned 
above, the candidate-rectangle determining unit 4 then detemiines the geometric inclusion of the thus-obtained two 
rectangles, the above-mentioned second one for the letters and third one for the card. Since the card geometrically 
completely included the letters, the third circumscribing rectangle for the card is selected to be stored in the rectangle 
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memory 3, and further determination will be perfomned on the thus-stored rectangle. 

[0055] The second preset extents (in dimensions, long-side dimension and short-side dimension as mentioned 
above) for the object used in the step S1 08 of FIG.2 as the reference data preferably include two kinds of extents, first 
kind thereof for the image part representing the object obtained by the method according to the second embodiment 
and second kind thereof for the image part representing the object obtained by the method according to the third 
embodiment. These two kinds of extents are, in the above-described example, one kind thereof for the business card 
and the other kind thereof for the letters printed for the business card. Thus, the step S108 can accurately perform the 
above-mentioned relevant operation using an appropriate kind of second preset extents of the above-mentioned first 
kind thereof and second kind thereof. That is, If the circumscribing rectangle obtained as a result of the method ac- 
cording to the second embodiment Is provided to the step S108, the first kind of the second preset extents for the 
object are used in the step S108, and if the circumscribing rectangle obtained as a result of the method according to 
the third embodiment is provided to the step S108, the second kind of the second preset extents for the object are 
used in the step S108. 

[0056] Thus, the above-described object extraction system in the fourth embodiment can flexibly process the Image 
data, for various cases, for example, not only the above-mentioned case in which the plate with the white surface is 
used to be placed on the glass on which a sheet, such as a business card was placed on, but also the above-mentioned 
case where the plate is not used so that the image is scanned while the open space Is present on and above the glass. 
[0057] Except for the above-described point, the system in the fourth embodiment is Identteal to each of the systems 
in the second and thinil embodiments. 

[0058] Further, it is also possible that a pieces of photograph is used as the above-mentioned object to be extracted 
through the present object extraction system, instead of using a business card for the same purpose as described 
above. In general, a piece of photograph has a white border portion in the periphery of a picture portion. Ordinarily, 
the picture portion has a density higher than that of the white border portion, that is, the picture portion has a lightness 
lower than that of the white border portion. Further, an outline of each portion of the picture portion and border portion 
has a rectangular shape and the rectangular outline of the border portion completely geometrically Include the rectan- 
gular outline of the picture portion . I n such a case, if the two-tone image signal is generated due to the above-described 
method according to the second embodiment, the rectangular outline of the picture portion is extracted as the circum- 
scribing rectangle in S102. If the two-tone image signal is generated due to the above-described method according to 
the third embodiment, the rectangular outline of the border portion is extracted as the circumscribing rectangle in S1 02. 
Since the rectangular outline of the border portion geometrically completely includes the rectangular outline of the 
picture portion, only the circumscribing rectangle extracted for the border portion is stored In the rectangle memory 3, 
but the circumscribing rectangle extracted for the picture portion is not stored therein. 

[0059] With reference to F1G.6, an object extraction and recognition system In a fifth embodiment of object extraction 
method and apparatus and object recognition method and apparatus according to the present invention will now be* 
described. Functions of the object extracting unit 22 includes those of the two-tone.image signal generating unit 11 , 
two-tone image signal memories A and B, 12 and 13, rectangle extracting unit 2, rectangle memory 3, rotation deter- 
mining unit 6, candidate-rectangle memory 5, side-length measuring unit 7, and object determining unit 8 shown in 
FIG.5. Further, the object-rectangle memory 9 is identical to that shown in FIG.5. 

[0060] A vector quantizing unit 24 performs a vector quantizing operation, described later, on the color-image signal. 
The color-image signal Is a signal which is input to the system shown In FIG.6 and processed in the object extracting 
unit 22. Thus, the data of the outline of the image part con-esponding to the above-mentioned object, as described 
above with reference to FIG.5 is extracted and stored in the object-rectangle memory 9. Values obtained as a result 
of performing the vector quantizing operation on the color-Image signal are stored in a vector quantized value memory 
25. A object recognizing unit 26 uses the values, stored in the vector quantized value memory 25 as mentioned above 
and also uses data representing the outline of the relevant image part, stored in object-rectangle memory 9 as men- 
tioned above with reference to FIGS.1 and 5. Using the values and data, the object recognizing unit 26 selects values 
among the values stored in the vector quantized values memory 25 using the data stored in the object rectangle memory 
9. In the object extraction and recognition system In the fifth embodiment of the present invention, the above-mentioned 
object, to be extracted from the Input image and recognize the thus-extracted one as the object, includes a plurality of 
objects. The object recognizing unit 26 determines which object of the above-mentioned plurality of objects the cun-ently 
processed image part is relevant, as described later. This recognizing operation is performed by comparing the values, 
selected from among the memory 25 as mentioned above, with values, which values are previously produced dictionary 
infonnation described later. Thus, the unit 26 detemiines whether or not the image data having the outline stored In 
the object-rectangle memory 9 corresponds to the above-mentioned object. A control unit 27 overall controls the other 
units shown in FIG.6. 

[0061] With reference to F1G.7 and FIGS.11A and 11B, details of the object extraction and recognition system In the 
fifth embodiment will now be described. As mentioned above, the object extracting unit 22 and the object-rectangle 
memory 9 have functions identical to those of the object extraction system shown in FIG.5. In addition to the functions 



10 



EP 0 657 839 B1 



identical to those of the system shown in FIG.5, the object extracting unit 22 has a function to provide a trigger signal. 
The above-mentioned trigger signal indicates timing at which the object extracting unit 22 receives data, which data 
is included in data carried by the above-mentioned color-image signal, and represents a certain one of the image parts. 
The certain one of the image part is an image part for which the object extracting unit 22 has extracted the circumscribing 

5 rectangle and also has determined that the thus extracted circumscribing rectangle as corresponding to the object as 
described above through the step S1 1 5 shown in FIG.2. After the object extracting unit 22 receives the above-mentioned 
data, the object-rectangie memory 9 provides scope data consisting of the data representing the outline of the relevant 
Image part In the memory 9. The vector quantizing unit 24 consists of a vector quantizing processing unit 35 and a 
memory 39 named code book, described later, shown in FIG. 7. The object recognizing unit 26 consists of an object 

^0 recognizing processing unit 41 and a memory 44 named dictionary, described later, shown in FIG.7. The above-men- 
tioned trigger signal and scope data are provided to the vector recognizing processing unit 41 . 
[0062] The vector quantizing processing unit 35 includes a mesh dividing unit 36, a characteristic extracting unit 37, 
and a vector quantizing executing unit 38. The mesh dividing unit 36, in a step S201 shown in FIG. 11 B, divides the 
color image carried by the color-Image signal (consisting of R, G, and B signals) into small regions. Such dividing Is 

'5 perfonned as if a mesh (grid) is placed on the image. The characteristic extracting unit 37, in a step S202A of FIG. 
11 B. obtains an amount representing characteristics of each region of the thus-divided small regions. As described 
later, the amount representing characteristics consists of a chromaticlty histogram. The vector quantizing executing 
unit 38, in a step S202B of FIG. 11 B, compares the thus-extracted amounts with infonnation previously produced and 
stored in the code book 39. By the comparison, the unit 38 perfonns the vector quantizing operation in the step S202B. 

20 Data is obtained as a result of the vector quantizing operation perfomied on the amounts representing characteristics 
of the small regions of the color image data. The thus-obtained data is stored in the vector quantized value memory 
25 and may be referred to as 'vector quantized values', hereinafter. All of data carried by the color-Image signal input 
to the object extraction and recognition system shown in FIG. 6 is processed by the vector quantizing unit 24. 
[0063] How to perfonn the vector quantizing operation will now be described. FIG. 8 shows a comer of the above- 

25 mentioned color image. A finer grid shown in FIG.8 indicates pixels of pixels constituting the relevant color Images. A 
coarser grid indicates the small regions divided by the mesh dividing unit 36. In the example, each small region of the 
small regions consists of 64 pixels x 64 pixels. (In FIG.B, Indication of 64 pixels x 64 pixels for the small region is omitted 
of, but 28 pixels and 28 pixels are indicated therefor, for the sake of simplification of the drawing.) The mesh dividing 
unit 36 divides the small regions as described above and obtains image data of the 64 pixels x 64 pixels for each small 

30 region to be processed by the characteristic extracting unit 37. However, it is possible to reduce the number of pixels 
of the image data to be processed by the unit 37. Specifically, for example, as shown in FIG. 16, pixels are sampled 
from the 64 pixels x 64 pixels so that 7 pixels, along each of the vertical and horizontal directions, are left between 
each two pixels to be sampled. Thus, the number of pixels to be sampled is a number of 1/8 x 1/8 the 64 x 64, that is, 
64-1/8 X 64-1/8, for each small region. Image data of the thus-reduced number of pixels, that is, the thus compressed 

35 image data may be processed by the characteristic extracting unit 37. 

[0064] The characteristic extracting unit 37 obtains chromaticities Pr and Pg by the following equations (1) and (2) 
for each pixel using color image values R, G and B, carried by the above-mentioned color-Image signal and each value 
of R, G and B consisting of data of 8 bit: 

40 

Pr=256-R/(R+G+B) (1), 

and 

45 

Pg=256G/(R+G+B) (2). 

[0065] The thus-obtained chromaticities Pr and Pg of the pixels have only inf onmatloh of tone of colors and does not 
have infomriatlon dependent of a matter, for example, as to how strong a sheet having the color image printed thereon 
so is illuminated, the color Image being scanned to obtain the color-image signal. Thus, accurate object recognition can 
be achieved by using the chromaticities Pr and Pg without being adversely affected by, for example, the above-men- 
tioned illumination. If object (image) recognition is made using Image data depending on the illumination, adverse 
affection may occur in the following situation, for example: 

[0066] It is assumed that the image data is obtained as a result of scanning a book placed on a glass of a duplicator, 
55 while certain two pages of the book are opened and face the glass, the image scanning being made through the glass. 
In the scanning, first light is illuminated on the opened pages. If the book is thick, that is, the book has large number 
of pages, and the above-mentioned two pages are opened on the glass, parts of the two pages adjoining with each 
other at a binding part of the book may not come into contact with the glass and thus may be left without sufficiently 
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illuminated. According to the present embodiment of the present invention, even if some part in the relevant image are 
left without sufficiently illuminated, such a matter does not adversely affect the object recognition result, 
[0067] In fact, since the chromaticities Pr and Pg are obtained through the above-mentioned equations (1) and (2). 
obtaining a ratio of the signal R or G to the sum of the signals R. G and B, a component of the intensity, which intensity 
each of the signals R, G and B has, is eliminated and only the ratios are obtained. Further, as a result of multiplying 
the thus-obtained ratios by 256 in the equations (1) and (2), each of the chromaticities Pr and Pg can be expressed 
by 8 bits. 

[0068] Using the chromaticities Pr and Pg of the pixels, a histogram of the chromaticities Pr is obtained for each 
small region of the small regions. Further, a histogram of the chromaticities Pg is obtained for each small region of the 
small regions. Thus, each small region has the histogram of the chromaticities Pr and that of the chromaticities Pg. 
The present invention does not limit the vector quantizing operation to use the chromaticities Pr and Pg. Instead of 
this, Pb {=256-B/(R+G+B)) may be used and also, instead of use of such chromaticities, other color characteristics 
such as hue or saturation may be used. 

[0089] A histogram 401 shown in FIG.9 is a histogram consisting of the histogram of the chromaticities Pg and that 
of the chromaticities Pr. The horizontal axis shows 512 chromaticities (i = 0 through 511), being referred to as 'chro- 
maticity dimensions', hereinafter'. Among the 512 chromaticity dimensions, the first 256 chromaticity dimensions (I = 
0 through 255) are a chromaticity range for the chromaticities Pr and the remaining 256 chromaticity dimensions (i = 
256 through 511 ) are a chromaticity range for those Pg. The chromaticities Pr 0 through 255 corresponds to the chro- 
maticity dimensions (1 = 0 through 255), respectively. The chromaticities Pg 0 through 255 corresponds to the chro- 
maticity dimensions (i = 256 through 511), respectively. Among the 256 chromaticity dimensions for the chromaticities 
Pr, the chromaticity Pr of each pixel included in each small region may corresponds to one. Among the 256 chromaticity 
dimensions (1 = 256 through 511) the chromaticity Pg of each pixel included in each small region may corresponds to 
one. 

[0070] The horizontal axis is thus an axis of the chromaticity dimensions. The vertical axis of the histogram 401 of 
FIG.9 shows a appearance frequency for each chromaticity dimension of the total 51 2 (=256+256) chromaticity dimen- 
sions (i = 0 through 511). That Is, a height of a bar at each chromaticity dimension in the histogram produced for the 
small region indicates how many pixels having the relevant chromaticity are present in the relevant small region. There- 
fore, each chromaticity histogram 401 represents a vector having 512 dimensions, each dimension having a magnitude 
consisting of the appearance frequency. 

[0071] Code book information 402 shown in FIG.9 is infonnation stored in the code book 39 shown in FIG.7. The 
code book infonnation consists of a plurality of the chromaticity histograms Cq. C^, Cg, ... shown in FIG.9. How to 
produce the histograms Is substantially the same as how to produce the histogram 401 shown in FIG.9. However, the 
chromaticity histograms as the code book information are those obtained from the small regions of many color images 
including one of the above-mentioned object. The above-mentioned object is an object which the object extraction and 
recognition system shown in FIG.6 attempts to extract from the color image being input thereto. The histograms of the 
code book information preferably include those obtained from the small regions of color Images other then those of 
the above-mentioned object. The reason for including the chromaticity histograms the small regions of the other images 
will now be described. By having data of many kinds of Images, it is possible to change the above-mentioned object 
from the image part cun-ently used as the object to another image among those which the code book infonnation 
includes. Further, by use of data of many kinds of images other than the above-mentioned object, it is possible to 
determine the currently processed image part as being an image part included in the code book information but not 
correspond to the above-mentioned object. Such detennination is effective in a case where there is a large possibility 
of appearing of an image part similar to but not corresponding to the above-mentioned object. By having such similar 
but not corresponding image part in the code book infomiation, it is possible to detennlne such a similar Image part 
not to correspond to the above-mentioned object. 

[0072] In practice, very large number of Images are used to produce the very large number of chromaticity histograms 
in the same manner The code book information is produced by clustering ifye thus-produced histograms so as to obtain 
typical chromaticity histograms as the code book Infonnation. By such clustering, It is possible to effectively reduce 
the number of histograms to be used as the code book infonnation so that the capacity of the memory of code book 
can be made small and also time required to for the process using the code book information can be shortened. 
[0073] The vector quantizing executing unit 38 obtains a difference for each chromaticity dimension among those (i 
= 0 through 511) between the appearance frequency in the histogram 401 and that in each of the histograms of the 
code book information 402. Using the differences, which are thus obtained for each histogram of the histograms of 
code book infonnation. as a distance DCj between the relevant histogram 401 and each one of the histograms of the 
code book Infonnation 402 is obtained by, for example, the following equation (4): 



12 



EP 0 657 839 B1 



. ^" . ..2 
DCj= 2 (Hi-Cji)^ • • • (4) . 

5 

The above sign 'Hi* is referred to the appearance frequency at the chromaticity dimension Y of the histogram 401 . The 
above sign 'Cjr is refen^ed to the appearance frequency at the chromaticity dimension 'i' of the histogram Cj included 
in the code book information 402. As shown in the above equation (4), each difference (IHi-Cj) may be squared and 

10 summed for i = 0 through 511. Thus, the above-mentioned distance DCj is obtained. A method of obtaining the above- 
mentioned distance between the relevant histogram 401 and each one of the histograms of the code bool< infomnatlon 
402 is not limited to this method. Various methods are known and may be used for the same purpose. Using the 
distances thus-obtained for the histograms constituting the code book infonnation 402, the vector quantizing executing 
unit 38 deterniines a chromaticity histogram Cj from among those constituting the code book infonnation 402. The 

IS histogram to be determined as mentioned above Is a chromaticity histogram Cj having the minimum distance from the 
histogram 401 obtained from the relevant small region. The vector quantizing executing unit 38 stores the number] of 
the thus-detemiined histogram Cj In the vector quantized memory 40. The number j thus stored for each small region 
is referred to as a 'vector quantized values' or a 'VQ value', the small region being one among the small regions 
constituting the color Image represented by the Input color-image signal. The VQ values are stored in the vector quan- 
go tized value memory 25 shown in F1G.7. 

[0074] The object recognizing processing unit 41 includes a vector quantized value histogram producing unit 42 and 
a matching unit 43. The histogram producing unit 42 uses the above-mentioned vector quantized values of ones among 
the. above-mentioned small regions and thus produces a histogram. FIG.10 shows an example of the input color image 
which is divided as the 9 x 1 1 small regions through the mesh dividing unit 36 of FIG.7. A numeral shown In each small 

25 region In FIG.1 0 Is the relevant VQ value. The histogram of the vector quantized values will now be described. If, for 
example, the histogram is produced for all of the small regions shown in FIG.10, VQo=0, VQ^=8, VQ2=15, VQ3=7, 
VQ4=9, VQ5=14, VQ6=9, VQy^Z, VQ8=12, VQgsS, ... Forexample, ^02=15' is obtained since the numeral '2' is present 
in FIG.10 '15' times. That Is, an appearance frequency for the VQ value 2 is 15. 
- [0075] With reference to FIG.1 IB, an operating flow of an operation perfonmed through the object recognizing 

30 processing unit 41 shown In FIG.7 will be described. As mentioned above, the object extracting unit 22 provides the 
trigger signal to the object recognizing processing unit 41 and the object-rectangle memory 9 provides the scope data 
to the same unit 41 . Such operations are perfonned after the step S108 shown In FIG.11 A has provided the detemil- 
nation result YES for the currently processed image part and stores data of the outline of the Image part in the object- 
rectangle memory 9. The steps S101, S102, 8103, S104, S105, S106, S107, and 8108 shown in FIG.IIAare sub- 

35 stantially identical to those shown in FIG.2. The scope data provided by the object-rectangle memory 9 consists of the 
data indicating the outline of the relevant image part. FIG. 1 2 shows an example of an edge of the color image processed 
in the system shown in FtG.6. In FIG.6, each square is the respective small region. The hatched small regions located 
lower part of FIG.1 2 are small regions, among those constituting the Input color image, each of the small regions being 
completely geometrically Included In the outline 501 of the relevant Image part. The histogram producing unit 42, in a 

40 step 3203 shown in FIG.11B, detemriines small regions completely geometrically included in the outline 501 using the 
above-mentioned scope data provided by the object-rectangle memory 9. The histogram producing unit 42 thus uses 
the VQ values-detemriined for each small region of the small regions constituting the Input color Image. The VP values, 
such as those shown in FIG.10, were stored in the vector quantized value memory 25 as mentioned above. Using the 
VQ values as mentioned above, in a step 8204 shown in FIG. 11 B, the histogram producing unit 42 produces the 

45 histogram of the vector quantized values such as those described above for the thus detemiined small regions com- 
pletely geometrically Included in the outline 501 . If the step S1 05 shown In FIG.1 1 A deterniines that the relevant image 
part is not one obtained as a result of the object being rotated, the object-rectangle memory 9 provides the scope data 
indicating an outline of the circumscribing rectangle which was produced for the relevant image part through the step 
8102 such as the rectangle 202 shown in FIG.3 or 301 shown in FIG.4, instead of the outline of the relevant image 

so part such as the rectangle 203 shown in FIG.3 or 302 shown in FIG.4. The histogram producing unit 42 uses the scope 
data indicating the outline of the circumscribing rectangle. Using the scope data, the histogram producing unit 42 
determines small regions, among the small regions constituting the input color image, completely geometrically includ- 
ed in the outline indicated by the scope data. The unit 42 thus produces in the step S204 the histogram of the vector 
quantized values for the thus-detennined small regions. 

55 [0076] With reference to FIG.13, a step 8205 shown in FIG. 118 perfonned by the matching unit 43 will now be 
described. The step 8205 compares the histogram of the vector quantized values obtained through the step 8204 with 
each one of the histograms of the vector quantized values stored In the dictionary 44 shown in FIG.7. A histogram of 
vector quantized values 601 is one example of that obtained for the relevant image part through the step 8204 as 
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described above. In this example, It is assumed that the code book infomiation 402 shown in FiG.9 has 64 chromatlclty 
histpgtam Cj G = 0 through 63) and thus the VQ value is a value among 64 values, 0 through 63. In the histogram 601 
Shown in FIG.13, the honzontai axis is an axis of vector quantized value dimensions for the above-mentioned 64 VQ 
values 0 through 63. The vertical axis is an axis of appearance frequencies, indicating how many times each one of 
the VQ values 0 through 63 appears in the above-mentioned small regions completely geometrically included in the 
outline of the relevant image part of the circumscribing rectangle. A height of each of the bare upward projecting from 
the respective vector quantized value dimension represents the relevant appearance frequency 
[0077] Histograms of vector quantized values Tq, T,, Tj. ... shown In FIG.13 are those included in the above-men- 
tioned dictionaiy intomiation stored in the dictionary 44 shown in FIG.7. As mentioned above, in the object extraction 
and recognition system in the fitth embodiment of the present invention, the above-mentioned object, to be extracted 
from the input image and recognize the thus-extracted one as the object, includes a plurality of objects The above- 
mentioned histograms of vector quantized values To, T„ Tj. ... corresponds to the plurality of objects. Each of these 
histograms was previously produced in a manner and has a fomi the same as the manner and the fom» in which the 
histogram 601 shown in FIG.13 is produced through the step S204. 

[0078] The above-mentioned dictionaiy information may be produced in a manner similar to one in which the above- 
mentioned code book infomiatlon is produced. That is, the histograms of vector quantized values constitute the dic- 
tionary information may include the histograms of vector quantized values obtained from not only the above-mentioned 
plurali^ of obje<ds but also from clustering the histograms of vector quantized values obtained from many other images 
Thus, advantages similar to the advantages obtained as a result of producing the code book infomiation by the clus- 
tering of data obtained from the small regions of many images. 

[0079] The matching unit 43 In the object recognizing processing unit 41 compares, in a step S205. the vector quan- 
tized value histogram 601 of the relevant image part with each of those constituting the dictionary information 602 
SpecificalV. the matching unit 43 obtains a difference, in the appearance frequencies for each vector quantized value 
dimension, between the histogram 601 of the relevant image part and each of those of the dictionary information 
similarly to obtaining the above-mentioned differences resulting In the above-mentioned distances DC]. Using the thus- 
obtained differences, distance DTK is obtained, as a result of the comparison of the histogram 601 and each of the 
histograms To, T,. Tj n a manner similar to obtaining the above-mentioned distance DCj, by, for example the 



t3 

DTk= S (VQj-Tkj)2 ... (5). 
j=0 

The above sign 'VQj- Is refen-ed to the appearance frequency at the VQ value dimension "f of the histogram 601 The 
above sign Tkj' is refen^d to the appearance frequency at the VQ value dimension of the histogram Tk Included in 
the dictionaiy information 602. Then, a histogram Is selected from among the histograms Tq, T, T, the thus- 
selected histogram being a histogram having the minimum distance DTk among those which the histograms of the 
dictionaiy infomiation have. Thus, an object is detemiined, from among the above-mentioned plurality of objects (ref- 
erence objects), as the object con-esponding to the currently processed relevant image part. That is the currently 
processed image part is identified to correspond to the thus-determined object among the plurality of objects 
[0080] If the step S103 provides the detemnination result NO. a step S112 determines whether or not all the image 
parts included m the input color image have been processed. If the determination result is NO, the step S103 is exe- 
cuted. Similariy, if the step SI 08 provides the determination result NO. a step S1 12 detemiines whether or not all the 
image parts included in the input color image have been processed. If the determination result is NO the step SI 03 
IS executed. However, if the step SI 08 provides the determination result YES, the subsequent steps S204 and 8205 
are performed and the object extraction and recognition operation for the input color image is finished If the step S1 1 2 
provides the determination result YES, that is, if the step SI 08 determines the currently processed image part not to 
correspond to the above-mentioned object for all the image parts present in the input color image, a step S1 13 deter- 
mines no image part corresponding to the above-mentioned object is present In the input color image. Then, the object 
extraction and recognition operation for the input color image is finished. 

[0081] In the object extraction and recognition system in the fifth embodiment of the present invention once the 
currently processed image part is determined to correspond to the object, the object extraction and recognition oper- 
ation for the input color image is finished. However, the present invention does not limit an operation flow thereof to 
such an operation flow. It is also possible to checks all the image parts present in the Input color Image even if the step 
SI 08 detemiines a plurality of image parte to correspond to the above-mentioned object. 

(0082] With reference to FIG.7. the image data processing (the appropriate steps of the steps S101 S102 S103 
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S104,S105, S106,S107,S108,andS112shown In RG.11A) through the object extracting unit 22 and object- rectangle 
memory 9 is performed in parallel with or simultaneously with the image data processing (the steps S201 , S202A, 
S202B, S203, S204, and S205) through the vector quantizing processing unit 35, vector quantized value memory 25, 
and object recognizing processing unit 41 , in the object extraction and recognition system in the fifth embodiment of 
the present invention. Further, with reference to FIG.11 A, the circumscribing rectangle is extracted from the input color 
image, the thus-extracted rectangle then undergoes the size detenmination process (steps S1 03 and S1 08), the image 
part of the rectangle, which has been detemilned to correspond to the above-mentioned object through the size de- 
tennination. then undergoes the recognition process (step S205), one by one for the image parts included in the input 
color image. Thus, it is possible to achieve real-time data processing. As a result, the object extraction and recognition 
operation can be perfomied accurately in high speed. Further, using the vector quantizing technique in the object 
recognition process enables effective compression of data amount being processed using full infonnation associated 
with the Image part to undergo the object recognition process. Specifically, for example, it is possible to reduce a scale 
of the dictionary 44. 

[0083] A color image recognition system in a sixth embodiment of color image recognition method and apparatus 
according to the present invention will now be described with reference to FIGS.14 and 15. The structure of the color 
image recognition system in the sixth embodiment is similar to that of the object extraction and recognition system in 
the fifth embodiment shown in FIGS.6 and 7. However, differently from the structure of the system shown in F1GS.6 
and 7, the image recognition system in the sixth embodiment shown In FIG.14 does not Include a function perfonmlng 
the above-described object extraction operation shown In FIG.11 A. Elements of the system shown in FIG.14 substan- 
tially identical to those of the system shown In F1GS.6 and 7 have the same reference numerals as those of the cor- 
responding elements of the system shown in FIGS.6 and 7, description of these element being thus omitted. 
[0084] The color image recognition system in the sixth embodiment shown in FIG.14 operates generally identically 
to the operation perfonned by the system shown in FIGS.6 and 7. However, differently from the operation of the system 
shown in FIGS.6 and 7, the system shown in FIG.14 perfomis the color image recognizing operation shown in FIG. 
15, that is, the object recognizing operation in the system show in FIGS.6 and 7, for the entirety of the Input color 
Image. The steps S201 , S202A, S202B, S204, and S205 are substantially the same as the steps having the same step 
numbers shown In FIG. 1 1 B, respectively. Furtiier, a characteristic memory 37A Is used to temporarily store the chro- 
maticities Pr and Pg therein obtained through the above-mentioned equations (1 ) and (2) by characteristic extracting 
unit 37. The vector quantizing executing unit 38 uses the thus-stored the chromatlcitles Pr and Pg as described above. 
The system in the sixth embodiment shown in FIG.14 performs substantially Identically to the operation performed by 
the system in the fifth embodiment shown in FIGS.6 and 7, except for the above mentioned points. 
[0085] The image recognizing processing unit 41 shown in FIG.14, in the step S205 shown in FIG. 16, identifies the 
currently processed color image which is represented by the input color-Image signal (signals R, G and B) to correspond 
to an image among a plurality of images. Each of the plurality of images is represented by a respective one of the 
histograms of vector quantized values Tq, T^, Tg, ... shown in FIG. 13. That is, the unit 41 compares the histogram 601 
representing the currentiy processed Image with each of the histograms of vector quantized values Tq, T^, T^, ... In- 
cluded in the dictionary Infomr^ation 602 so as to Identify the currently processed image to correspond to one of the 
plurality of images (reference Images). Thus, for example, In the above-mentioned example In which such Image rec- 
ognition method may be applied to works In a police office, a face of a suspected person or a montage picture of the 
face may be identified to con'espond to one included In the database of criminals' face photographs. 
[0086] According to the color image recognition system in the sixth embodiment, advantages,. the same as those 
obtained through the applying of the vector quantizing operation in the above-described system in the fifth embodiment 
will be obtained. 

[0087] A color image recognition system in a seventh embodiment of color Image recognition method and apparatus 
according to the present invention will now be described. The system in the seventh embodiment is substantially Iden- 
tical to the above-described system in the sixth embodiment, and performs substantially identically to the operation 
perfomied by the above-described system in the sixth embodiment, except for the following point: 
[0088] In the system in the above-described sixth embodiments, the mesh dividing unit 36 divides the small regions 
as described above and obtains image data of. for example, the 64 pixels x 64 pixels for each small region to be 
processed by the characteristic extracting unit 37. However, In the system in the seventh embodiment, the number of 
pixels of which image data obtained to be processed by the unit 37 is reduced. Specifically, for example, pixels are 
sampled from the 64 pixels x 64 pixels in each small region so that 7 pixels, along each of the vertical and horizontal 
directions, are left between each two pixels to be sampled. FIG.1 6 illustrates the manner of such a sampling operation. 
FIG. 16 shows a corner of the above-mentioned color image, similarto that shown in F1G.8. SImilariy, a finer grid shown 
in FIG.8 indicates pixels of pixels constituting the relevant color images and a coarser grid indicates the small regions 
divided by the mesh dividing unit 36. In the example, each small region of the small regions consists of 64 pixels x 64 
pixels. With reference to FIG.1 6 In comparison to FIG.8, hatched squares among squares shown In FIG.1 6 are the 
small regions to be actually used in obtaining the chromatlcities Pr and Pg. Thus, the number of pixels to be sampled 
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is a.number of 1/8 x 1/8 the 64 x 64, that is, 64-1/8 x 64-1/8, for each small region. Image data of the thus-reduced 
number of pixels, that is, the thus compressed Image data may be processed by the characteristic extracting unit 37 
to obtain the chromaticities Pr and Pg. By reducing the number of pixels to be used as described above, it is possible 
to effectively reduce the scale of the relevant parts of the system and effectively reduce time required for the processing 
of the pixel data. 

[0089] A color image recognition system in a eighth embodiment of color image recognition method and apparatus 
according to the present invention will now be described. The system in the eighth embodiment is substantially identical 
to the above-described system in the sixth embodiment, and performs substantially identically to the operation per- 
formed by the above-described system In the sixth embodiment, except for the following point: 
[0090] According to the above-described sixth embodiment, the chromaticity histogram has 512 chromaticity dimen- 
sions as described above in the description of the fifth embodiment with reference to FIG.9. Since the number of the 
chromaticity dimensions is relatively large, the relevant memory capacity is required to be large and time required to 
compare the input Image with the reference images (matching) is long. 

[0091] In the eighth embodiment, the number of the chromaticity dimensions is reduced to, for example, 64 dimen- 
sions. The chromaticity histograms obtained using the thus-reduced number of the chromaticity dimensions are then 
used in the subsequent image recognizing process (S202B, S204, and S205 shown in FIG.16), The reduction of the 
chromaticity dimensions is performed as follows: 

[0092] First, the above-mentioned Pr and Pg are obtained through the above-mentioned equations (1 ) and (2). Then, 

If Pr<64, new Pr = 0; 

if 64<Pr<1 92. new Pr = (Pr-64)/4; and 

if 192<Pr, new Pr = 31. 

If Pg<64, new Pg = 32; 

if 64<Pr5l92, new Pg = (Pr-64)/4+32; and 

If 192<Pr, newPg = 63. 

[0093] Then, the chromaticities new Pr 0 through 31 corresponds to the 32 chromaticity dimensions (i = 0 through 
31) and the chromaticities new Pg 32 through 63 con^esponds to the 32 chromaticity dimensions (I = 32 through 63). 
Thus, the chromaticity histograms, each having 32 chromaticity dimensions are produced. 

[0094] According to the systems in the seventh and eighth embodiments, since data amount can be effectively re- 
duced. 

[0095] A color Image recognition system in a ninth embodiment of color image recognition method and apparatus 
according to the present invention will now be described. The system in the ninth embodiment is substantially identical 
to the above-described system in the sixth embodiment, and performs substantially identically to the operation per- 
formed by the above-described system in the sixth embodiment, except for the following point: 
[0096] The above point relates to the comparison (matching) operation of the input Image with the plurality of images 
Included in the dictionary infonnatlon 602 perfomned by the image recognizing processing unit 41 shown In FIG.14. A 
threshold value for the distances DTk, which are shown in FIG.13, is previously provided. With reference to FIG. 17, 
in a step S206, if the distance DTk is equal to or smaller than the threshold value, it is detemnined that the relevant 
histogram Tk among those T^, Tg. T3, ... included in the dictionary information 602 may correspond to the input Image. 
However, If the distance DTk is larger than the threshold value, it is detemiined that the relevant histogram Tk among 
those T^, Tg. T3, ... included in the dictionary Infomiation 602 does not correspond to the input image. Thus, candidates 
of the histograms are detenmined from among those T,, T2, T3 If no candidates are present in the dictionary infor- 
mation 602, it is determined in a step S209 that no reference image corresponds to (matches) the input image. If it Is 
determined that some candidates are present as a result of the step S206, a step S208 determines one of the thus- 
determined candidates, which one has the minimum distance DTk among those of the candidates. By this method, it 
is possible to detemilne that the input image does not match any of the images Included in the dictionary information. 
Thus, It is possible to improve accuracy In the Image recognition. 

[0097] A color image recognition system in a tenth embodiment of color image recognition method and apparatus 
according to the present invention will now be described. The system in the ninth embodiment is substantially identical 
to the above-described system in the ninth embodiment, and performs substantially identically to the operation per- 
formed by the above-described system In the ninth embodiment, except for the following point: 
[0098] The point relates to the above-mentioned threshold value for the distances DTk provided in the above-de- 
scribed ninth embodiment. In the system in the tenth embodiment, the above-mentioned threshold value is determined 
depending on each image among the Images which are stored as the histograms T^, Tg, T3, ... in the dictionary 44. 
Thus, it Is possible to provide a number of threshold values different from one another, the number being the same as 

the number of histograms T,, T2, T3 In the histogram comparison step S206 shown in FIG.17, the distance DTk 

(DTi , DTg, DT3, . .,) is obtained for each one of the histograms T^ , Tg, T3 Then, each of the thus-obtained distances 
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DTk is compared with the respective one of the threshold values given to the histogranr^s T^, Tg, T3, .... Thus, the 
candidate is determined such that the histogram, the distance DTk of which is equal to or smaller than the relevant 
threshold value, can be the candidate. If the distance DTk is larger than the relevant threshold value, the relevant 
histogram cannot be the candidate. By this method, it is possible to perform the image matching processing flexibly to 

5 be appropriate to characteristics of each image of the images, the histograms of which are stored in the dictionary 44. 
Specifically, for example, an image k among the images stored in the dictionary In the fomri of the histograms has 
characteristics such that the image k is very similar in their histograms to another Image j. In such a case, the threshold 
value forthe image k may be smalt enough so that, if the input image actually corresponds to the image j, it is possible 
to detennine the input image does not match the image k in the step S206. Thus, it is possible to prevent such a similar 

10 but different image from being determined to match the relevant image k In the step S208. Thus, it is possible to further 
improve accuracy in the image recognition. 

[0099] A color image recognition system in a eleventh embodiment of color image recognition method and apparatus 
according to the present invention will now be described with reference to FIG.1 8. The system in the eleventh embod- 
iment is substantially identical to the above-described system in the sixth embodiment shown in FIG. 1 4, and perfomis 
15 substantially identically to the operation perfomied by the above-described system in the sixth embodiment, except 
for certain points which will be described later. Elements of the system shown in FIG. 18 substantially identical to those 
of the system shown in FIG. 14 have the same reference numerals as those of the corresponding elements of the 
system shown In FIG 14, description of these element being thus omitted. 

[0100] The control unit 27A overall controls the other units shown in FIG.1 8. The characteristic extracting unit 37B 
20 and a conversion compressing table 50 produce chromaticity histograms different from the chromaticity histograms 
produced by the characteristic extracting unit 37 shown in FIG.1 4. Similarly, the code book stores the code book in- 
formation consisting of the characteristic histograms previously provided in a manner the same as the manner in which 
the chromaticity histogram extracting unit 378 and conversion compressing table 50 produce the chromaticity histo- 
grams. The chromaticity histograms are produced for each small region of the above-described small regions consti- 
25 tuting the input color image similarly to the relevant operation in the system in the sixth embodiment. The thus-produced 
chromaticity histograms are stored in the characteristic memory 37C and then used by the vector quantizing unit 38 
similariy to the relevant operation in the system in the sixth embodiment. 

[0101] The characteristic extracting unit 378, for each pixel of the pixels constituting the relevant small region, uses 
the input color image signals R, G and B and thus obtains the above-mentioned chromattoities Pr, Pg and Pb through, 
30 for example, the following equations (1), (2) and (3): 

Pr=256.R/(R-»-G+B) (1), 
Pg=256.G/(R+G+B) (2). 

and 

40 

Pb=256.B/{R+G+B) (3). 

The characteristic extracting unit 37B causes the thus-obtained chromaticities Pr, Pg and Pb to undergo data com- 
pression process using the conversion compressing table 50. One embodiment of the data compression process will 

45 now be described with reference to FIG.1 9. According to the compression converting table 60 shown in FIG.1 9, for 
each chromaticity of the chromaticities Pr, Pg and Pb, a chromaticity range consisting of the 256 chromatfcities 0 
through 255 is converted into a chromaticity range consisting of 16 chromaticities 0 through 15. For example, a chro- 
maticity 255 Is converted into 15, Further, the data conversion of the conversion compressing table 50 is perfonned 
according to a conversion curve 51, not linear, shown In FIG.19. That Is, In a part where the Input value is a small 

50 value, that is, the left side in FIG.19, a a small number of the Input values are converted Into the single output value. 
However, in a part where the input value is a large value, that is, the left side in FIG.19, a large number of the Input 
values are converted into the single output value. 

[01 02] The characteristic extracting unit 378 uses the thus-obtained chromaticities Pr, Pg and Pb, and produces the 
chromaticity histograms 401 A, an example of which is shown in FIG.19. The above-mentioned conversion using the 
55 conversion compressing table 50 can reduce the chromaticity dimensions which corresponds to the scale of each of 
the chromaticity histograms. Thus, the relevant memory capacity can be reduced and also the matching processing 
(image recognition operation) can be perfonned in high speed. 

[0103] As shown in FIG.1 9, each of the histogram 401 A has the horizontal axis of the 47 chromaticity dimensions (i 
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= 0 through 48). Among the 47 chromaticity dimensions, the first 16 dimensions (i = 0 through 15) correspond to the 
16 chromaticittes of Pr, the second 16 dimensions (i = 16 through 31) correspond to the 16 chromaticities of Pg the 
fast 16 dimensions (i = 32 through 47) correspond to the 16 chromaticities of Pb. Similar to the histograms 401 shown 
in RG.9, a height of each of the bars upward projecting from the respective chromaMclty dimension represents the 
relevant appearance frequency of the chromaticities for the relevant small region. 

[01 041 The data compression ratio Is not limited to the above^nentloned ratio of 1 6 to 256. Various data compression 
ratios can be applied appropriately. Further, the above-described characteristic extracting operation is not limited to 

that using thechromaticihesPr.Pg and Pb. Instead of the chromaticities, the YMC (Yellow. Magenta and Cyan)signals 
may be used as characteristic values to produce histograms instead of the chromaticity histograms. The YMC signals 
are obtained as a result of appropriately converting the RGB signals. Further, the Lab signals (corresponding to the 
r„r.rK ? '-•a-b- color space, that Is, CIE1 976 L-a*b- color space) may be used as characteristic values to 
produce histograms instead of the chromaticity histograms. 

nf !f I r'°"^° "''f ^"^^P' °' chromaticity dimensions of each chromaticity histogram 

o ipJ" n pro ? °' 1 '"^^^^ ^'^ '"^ '"'"'9^' ^' ^' - «" ^ information 402 

or 402A. In FIG.9, the number of chromaticity dimensions Is 51 2 while in FIG.20. the same is 48 

[0106] A color image recognition system In a twelfth embodiment of color Image recognition method and apparatus 
according to thepresent Invention will now be described. Thesystem in the twelfth embodiment is substantially identical 
to the above-descnbed system In the eleventh embodiment, and perfomis substantially identically to the operation 
mJ«T*l^ above-described system in the eleventh embodiment, except for the following point 
S^hli- f 1*"*^"°" quantizing unit 38 is different from that in the system in the eleventh 

embod ment. In the system m the eleventh embodiment, the chromaticity histograms produced for all the small regions 
are uniformly compared with all the histograms stored in the code book 39A. As a result, the VQ values are gi>«n to 

nrlnT ,K ^'""^ T ^ ^^'^ "^^^^ embodiment, manners in which the histo- 

grams of the small regions are compared with the code boolc Infomiation are different among the small regions The 

rr«?rf- '^T'^'"^'^- *" ^"""'"'"9 histograms of the small regions. Thus, the small regions 

constituting certain part in the input image are substantially omitted from being used to compared with the code book 
^ omahon. The above-mentioned certain part is. for example. In the input image, a background with respect of a 
relevant foreground, or a white sheet being exposed around a something printed on the white sheet, each of the 
foreground and the something being essential to be recognized but each of the background and the exposed white 
sheet being not necessary to be examined. Each of the background and the white sheet may include therein noise 
patterns which may adversely affect the proper recognition perfomiance of the color image recognition system By 
removing such extra data from being substantially examined, it is possible to improve lecognitlon (identification) suc- 
cess ratio and to improve data processing rate (percentage). 

[01081 Generally speaking, in such a background or an exposed white sheet, image density is unlfomi in each of the 
small regions. As a result, thechromatteity histogram producedforthesmall region should be such thatthe appearance 
frequencies at specific concentrated ones among the series of chromaticity dimensions in the horizontal axis scale are 

f^lT" ^V!lf ""^^ ^™ "^^^ " ""^'y "'^^ ^^^^^ °' the appearance 

frequencies is arge. and those of the significant values are distributed at a narrow extent In the horizontal axis scale 

«^«nT"®!f ^ "'at "the maximum value of the appearance frequencies in the relevant small 

region exceeds a predetemiined threshold value, the vectorquantizing unit38 detemiines thatthe relevant small region 

corresponds to an image part in which an image density is unifom, all over, that is. the above-mentioned certain part 

Which should be removed from further examination. The unit 38 thus gives a specific VQ value, such as "0" to the 

relevant small region. The unit 38 then treats the small regions having the VQ value "0" as ones to be Ignored. Instead 

of givmg the specific VQ value if the maximum appearance frequency exceeds the predetemiined value, it is also 

nlTJ! '° PT^";'''^ comparison with the code book infom«tlon 402A if an appearance frequency exceeds a pre- 

me vector quantizing process) , the certain part being a part in which color is generally unlfomi all over 
.h h ■ K !• "='^'^""'"'"9 « P«'* the input Image as that to be omitted from being further processed using 

^rwhi'^h 

niTm c'^u ^PP««;«"=«"-«1"encies of significant values are concentratedly distributed, forthe same detemiination 
[0110] Further, for the same detemiinatlon, it is also possible to use infomiation as to which part in the horizontal 
axis scale the appearance frequencies of significant values are distributed. For example, a white background part is 

frombeingfurtherprocessed. AS described above, the noise image infomiation may be induded in relevantinfomialion 
!L .Tl ^ T*"? ■ ^" scanner reads In infomiation of not only an relevant image printed on a relevant 
Itl T u ^T Z '^^^ P""'^ °" subsequent to the relevant sheet. In such a case the 

white background part even including such noise are generally white so that the above-mentioned method in which 
infomiation as to which part .n the horizontal axis scale the appearance frequencies of significant values are distributed 
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is used. 

[01 11] Further, instead of determining such a part in the input image as that to be omitted from being further processed 
using the heights of, widths of, and positions in the histograms as described above, other characteristics may be used 
for the same purpose. The other characteristics are those obtained as a result of analyzing the histograms. 

5 [0112] A color image recognition system in a thirteenth embodiment of color image recognition method and apparatus 
according to the present invention will now be described. The system in the thirteenth embodiment is substantially 
identical to the above-described system in the eleventh embodiment, and perfonns substantially identically to the op- 
eration perfomied by the above-described system in the eleventh embodiment, except for the following point: 
[01 13] In the system in the eleventh embodiment, a VQ value are given to each small region if the above-described 

10 distance DCj between the histogram 401 A of the small region and that of the relevant histogram of the code book 
infomiation 402A is the smallest among the histograms of the code book infomiation 402A. However, as described 
above, the code book information may be fonned as a result of clustering a huge number of various Images. As a 
result, if the input image is different from any one of the images, the histograms of which are stored as the dictionary 
Infomiation 602 shown in FIG.1 3, the distance DCj between the histogram of the input image and each of the histograms 

IS of the code book information may be large. In this embodiment, if the minimum distance DCj has a value larger than 
a predetennined threshold value, no VQ value is given to the relevant small region in the vector quantizing unit 38. As 
a result, the matching (comparison with the dictionary information) process perfomned by the image recognizing unit 
41 using the thus produced VQ values can be simplified in such a case. As a result, it is possible that the image 
recognizing unit 41 determines that the dictionary 44 has no data matching the input image if no significant VQ values 

20 are given to the input image. Thus, it is possible to achieve high-speed detennination. 

[01 14] A color image recognition system in a fourteenth embodiment of color image recognition method and appa- 
ratus according to the present invention will now be described. The system in the fourteenth embodiment is substantially 
Identical to the above-described system in the eleventh embodiment, and performs substantially identically to the op- 
eration perfonned by the above-described system in the eleventh embodiment, except for the following point: 

25 [01 1 5] The above point relates to the comparison (matching) operation of the input image with the plurality of images 
included in the dictionary infomriatlon 602 performed by the image recognizing processing unit 41 shown in FIG. 18. A 
threshold value for the distances DTk, which are shown in FIG.1 3, Is previously provided. With reference to FIG.1 7, 
in a step S206, if the distance DTk Is equal to or smaller than the threshold value, it is detemnined that the relevant 
histogram Tk among those T^, T2, T3, ... included in the dictionary infonmation 602 may correspond to the input image. 

30 However, if the distance DTk is larger than the threshold value, it Is detemnined that the relevant histogram Tk among 
those T^, T2, T3, ... included in the dictionary Information 602 does not correspond to the input image. Thus, candidates 
of the histograms are detennined from among those T^, Tg, T3, .... If no candidates are present in the dictionary infor- 
mation 602, it is determined in a step S209 that no reference image corresponds to (matches) the input image. If it is 
determined that some candidates are present as a result of the step S206, a step S208 detennines one of the thus- 

35 detennined candidates, which one has the minimum distance DTk among those of the candidates. By this method, it 
is possible to detenrtine that the input image does not match any of the Images included in the dictionary information. 
Thus, It is possible to improve accuracy In the image recognition. 

[01 16] A color Image recognition system in a fifteenth embodiment of color image recognition method and apparatus 
according to the present Invention will now be described. The system In the fifteenth embodiment is substantially 

40 identical to the above-described system in the fourteenth embodiment, and performs substantially Identically to the 
operation performed by the above-described system in the fourteenth embodiment, except for the following point: 
[0117] The point relates to the above-mentioned threshold value for the distances DTk provided in the above-de- 
scribed fourteenth embodiment. In the system in the fifteenth embodiment, the above-mentioned threshold value Is 
detennined depending on each Image among the images which are stored as the histograms T^, T2, T3, ... in the 

^5 dictionary 44. Thus, It is possible to provide a number of threshold values different from one another, the number being 
the same as the number of histograms T^, Tg, T3, .... In the histogram comparison step S206 shown in FIG. 17, the 
distance DTk (DT^, DTg, DT3, ...) Is obtained for each one of thei histograms T,, T2, T3 Then, each of the thus- 
obtained distances DTk is compared with the respective one of the threshold values given to the histograms T^, T2, 
T3 Thus, the candidate is determined such that the histogram, the distance DTk of which is equal to or smallerthan 

50 the relevant threshold value, can be the candidate. If the distance DTk is larger than the relevant threshold value, the 
relevant histogram cannot be the candidate. By this method, it is possible to perfonn the image matching processing 
flexibly to be appropriate to characteristics of each image of the images, the histograms of which are stored in the 
dictionary 44. Specifically, for example, an Image k among the Images stored in the dictionary in the form of the histo- 
grams has characteristics such that the image k is very similar in their histograms to another image j. In such a case, 

55 the threshold value for the image k may be small enough so that, if the input image actually corresponds to the image 
], It is possible to detennine the Input image does not match the image k in the step S206. Thus, it is possible to prevent 
such a similar but different Image from being detemnined to match the relevant image k in the step S208. Thus, it is 
possible to further inriprove accuracy in the image recognition. 
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[01181 Further, the present invention Is not limited to the above-described embodiments, and variations and modifi- 
cations may be made without departing from the scope of the present invention as defined by the appended claims. 



10 



Claims 

1 . A color image recognition method, characterized In that: 
said method comprises steps of: 

a) (S202A, S202B) extracting characteristics from an Input color image signal; 

b) (S101 through S108) finding a candidate image part corresponding to a plurality of possible objects 
from an input color image represented by said Input color Image signal, in parallel with said step a) by 
means of an object extraction method; and 

c) (S205) selecting one of said plurality of possible objects as relevant by using said extracted character- 
istics which correspond to the candidate image part. 

2. The color image recognition method according to claim 1 , characterized in that: 
said step c) Is executed only after a time said step b) had found said candidate image part. 

3. The color Image recognition method according to claim 1 or 2 wherein said step b) comprises the steps of: 

ba) (S1 02) detennining a circumscribing rectangle from an Input two-tone Image signal; 
said circumscribing rectangle being a rectangle circumscribing an image part which consists of continuous 
pixels, each of said pixels being a pixel of a predetermined same tone; 

bb) (SI 02) detecting contact positions at which said circumscribing rectangle comes Into contact with said 
image part; and 

Ix!) (SI 06, SI 07, S1 08. 811 5, 311 6) detemiining whether or not said image part Is identical to a given object, 
the determination being performed using said contact positions. 

4. The color image recognition method of claim 3, characterized in that: 

said given object has a rectangular shape, said rectangular shape of said given object having predetermined 
lengths of sides thereof; and 
said step be) comprises steps of: 

bc-1) (S106. S107) determining, based on an assumption that said Image part has a rectangular shape 
lengths of sides of said rectangular shape of said image part; 

bc-2) (SI 08) comparing said lengths of sides of said rectangular shape of said image part with said pre- 
detemiined lengths of sides of said rectangular shape of said objects, and 

bc-3) (3115, 3116) determining whether or not said image part is identical to said given object, based on 
a result of comparison perfomied through said step bc-2). 
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5. The color image recognition method of claim 4, characterized in that: 
said step b) further comprises a step of 

bd) (S105) determining whether or not said image part is an image part obtained as a result of rotating said 
rectangular shape of said object; 
and wherein: 

said step bc-1) can properly detennine lengths of sides of said rectangular shape of 
said image part using a determination result given by said step bd). 

S5 6. The color Image recognition method according to claim 3, characterized In that: 

said step b) further comprises steps of; 
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be-1 ) (S1 01 ) obtaining a first one of said input two-tone image signal from an input color Image signal, in 
a first manner, as a result of comparing a lightness value represented by said input color image signal 
with a first threshold value; 

be-2) (S1 01 ) obtaining a second one of said input two-tone image signal from said input color image signal, 
5 in a second manner, as a result of comparing said lightness value represented by said input color image 

signal with a second threshold value; 

and wherein said step ba) detennlnes a first one of said circumscribing rectangle from said first one of 
said Input two-tone image signal, and determines a second one of said circumscribing rectangle from said 
second one of said input two-tone image signal. 

10 

7. The object extraction method according to daim 6, characterized In that: 

said step b) further comprises steps of 

bf) detemiining whether or not said first one of said circumscribing rectangle geometrically completely Includes 
said second one of said circumscribing rectangle, and detemiining whether or not said second one of said 
circumscribing rectangle geometrically completely includes said first one of said circumscribing rectangle; and 
be) removing a certain one of said first one and second one of said circumscribing rectangles from undergoing 
said steps bb) and be), if said step bf) has determined that said certain one geometrically completely includes 
a remaining one of said first one and second one of said circumscribing rectangles. 

20 

8. A color image recognition method according to claim 1 , characterized In that: 

a step a) comprises the substeps of 

a1 ) (S201 ) dividing an input color image into small regions; 

a2) (S202A) extracting characteristics from said small regions of said input color image signal; 
a step c) comprises the substeps of: 

c1) (S204) selecting a reference characteristic collection from among a plurality of reference characteristic 
collections for each of said small regions, such that the thus-selected reference characteristic collection has 
characteristics having the highest degree of similarity to said characteristics extracted from said each of said 

small regions; 

each of said plurality of reference characteristic collections having an identification number and thus the iden- 
tification number of the thus-selected reference characteristic collection being given to said each of said small 
35 regions; 

and 

c2) (S205) selecting an object from among said plurality of possible objects as relevant such that: 

the thus-selected object is previously divided into the small regions, 
^ the Identification number of a reference characteristic collection among said plurality of reference char- 

acteristic collections is previously given to each of said small regions of said thus-selected object, and 
characteristics of a set of the identification numbers given to said small regions of said thus-selected object 
have the highest degree of similarity to characteristics of a set of the identification numbers corresponding 
to the thus-selected object. 

45 

9. The color image recognition method according to claim 8. characterized in that: 

said step a2) comprises steps of: 

^° a2-1) sampling pixels from among pixels constituting each of said small regions which constitutes said 

input color image, and 

b-2) using image data of the thus-sampled pixels to extract said characteristics from said small regions. 

10. The color image recognition method according to claim 8, characterized in that: 
55 said method further comprises a step of 

e) converting said characteristics, which have been extracted by said step a2), so that a date amount of said 
characteristics is reduced. 



21 



20 



25 



EP 0 657 839 B1 

11. The color image recognition method according to claim 8, characterized in that: 
said method further comprises steps of: 

f) obtaining a value for each of said plurality of objects, said value representing how the reference characteristic 
5 collections given to said small regions of said each of said plurality of objects is similar to the reference char- 

actenstic collections given to said small regions of said input color image; and 

g) comparing said value obtained through said step f) with a threshold value so as to determine whether or 
not said each of said plurality of objects is a candidate of objects among said plurality of objects, said candidate 
of objects being those each of which have a possibility of being determined to be identical to said Input color 

^0 image. ^ 

12. The color image recognition method according to claim 11 , characterized In that: 

said threshold value used in said step g) is detennined individually for each of said plurality of objects based on 
features of said plurality of objects. 

15 

13. The color image recognition method according to claim 8, wherein a manner of said step c1) varies among said 
small regions constituting said input color image, depending on the characteristics extracted through said step a2) 
for each of said small regions constituting said input color image. 

14. The color image recognition method according to claim 8, characterized In that: 

each of the characteristic collections comprises a histogram of appearance frequencies, 
the identification numbers of characteristic collections among said characteristic collections being given to the 
small regions of said input color image and said plurality of objects, 

each of said appearance frequencies being an appearance frequency of pixels having same characteristics. 

15. The color image recognition method according to claim 14, characterized in that: 
said characteristics extracted through said step a2) comprise chromaticities. 

16. The color image recognition method according to claim 14, characterized in that: 
said method further comprises a step of 

h) preventing said step c1 ) from being executed if the appearance frequency of the histogram of a small region 
among said small regions constituting said input color image exceeds a predetermined value. 

17. The color image recognition method according to claim 16, characterized In that: 
said method further comprises a step of 

i) giving a predetennined number to said small region, said appearance frequency of which exceeds said 
predetennined value in said step 

18. The color image recognition method according to claim 14. characterized in that: 
said method further comprises a step of 

j) preventing said step c1) from being executed if only a number of appearance frequencies among the ap- 
pearance frequencies constituting the histogram of a small region among said small regions constituting said 
input color image have significant values, 

said number of appearance frequencies being those of the characteristics approximating one another, and said 
number being less than a threshold value. 

19. The color image recognition method according to claim 18. characterized In that: 
said method further comprises a step of 

l<) giving a predetenTiined number to said small region, said step j) having prevented said step c1 ) from beina 
executed for said small region. 
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20. The color image recognition nfiethod according to claim 8, characterized in ttiat: 
said method further comprises a step of: 

I) preventing said step cl) from being executed 
5 if the characteristics of each reference characteristic collection among the plurality of reference characteristic 

collections has similarity to said characteristics extracted from said each of said small regions, said similarity 
being one of less than a predetermined degree; and 

m) giving a predetermined number to said small region, said step 1 ) having prevented said step c1 ) from being 
executed for said small region. 

10 

21. The color image recognition method according to claim 8, characterized in that: 
said step c2) selects the object from among said plurality of objects such that: 

the thus-selected object being previously divided into the small regions; 

the identification number of a reference characteristic collection among said plurality of reference characteristic 
collections being previously given to each of said small regions of said thus-selected object, 
a histogram of a set of the identification numbers given to said small regions of said thus-selected object 
having the highest degree of similarity to a histogram of a set of the identification numbers corresponding to 
the thus-selected object; 

each of the histograms comprising a histogram of appearance frequencies, each of said appearance frequen- 
cies being an appearance frequency of the small regions having the same identification number. 

22. A color image recognition apparatus, characterized in that: 
said apparatus comprises: 

25 

means (37) for extracting characteristics from an input color Image signal; 

means (22) for finding a candidate image part con'esponding to a plurality of possible objects from an input 
color Image represented by said Input color image signal, in parallel with said extracting means by means of 
an object extracting means; and 

means (41 ) for selecting one of said plurality of possible objects as relevant by using said extracted charac- 
teristics which correspond to the candidate image part. 

23. The color image recognition apparatus according to claim 22 characterized in that: 
said means (22) for finding a candidate image part comprises: 

35 

means (2) for determining a circumscribing rectangle from an input two-tone image signal; 

said circumscribing rectangle being a rectangle circumscribing an image part which consists of continuous 

pixels, each of said pixels being a pixel of a predetemnined same tone; 

means (2) for detecting contact positions at which said circumscribing rectangle comes into contact with sard 
^ Image part; and 

means (4) for detemriining whether or not said Image part is Identical to a given object, the detemiinatlon being 
perfomied using said contact positions. 

24. A color Image recognition apparatus according to claim 22, characterized in that: 
^5 said means for extracting comprises: 

means (36) for dividing an input color image into small regions; 
means (37) for extracting characteristics from said small regions; 
said means for selecting comprises: 

so 

means (38) for selecting a reference characteristic collection from among a plurality of reference charac- 
teristic collections for each of said small regions, such that the thus-selected reference characteristic col- 
lection has characteristics having the highest degree of similarity to said characteristics extracted from 
said each of said small regions; 

each of said plurality of reference characteristic collections having an identification number and thus the 
identification number of the thus-selected reference characteristic collection being given to said each of 
said small regions; 
and 



23 



EP 0 657 839 B1 



means (41) for selecting an object from among said plurality of objects as relevant such that: 
the thus-selected object being previously divided into the small regions, 

the identification number of a reference characteristic collection among said plurality of reference 
characteristic collections being previously given to each of said small regions of said thus-selected 
object, 

characteristics of a set of the identification numbers given to said small regions of said thus-selected 
object having the highest degree of similarity to characteristics of a set of the Identification numbers 
con^espondlng to the thus-selected object. 



PatentansprQche 



1 . Farbbilderkennungsverfahren, dadurch gekennzelchnet, dass 
das Verfahren folgende Schritte umfasst: 
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a) (S202A, S202B) Charakteristiken werden aus einem Eingangs-Farbbildslgnal extrahiert; 

b) (S101 bis S108) ein Kandidatenbildteil, der einer VIelzahl mogllcher Objekte entspricht, wird ausgehend 
von einem Elngangs-Farbbild gefunden, das durch das Eingangs-Farbbildslgnal dargestellt wird, und zwar 
parallel zu dem Schritt a) mittels eines Objekt-Extraktionsverfahrens; und 

c) (S205) eines der VIelzahl von mogllchen Objekten wird als relevant ausgewahlt. indem die extrahierten 
Charakteristiken verwendet werden, die dem Kandidatenbildteil entsprechen. 

Farbbilderkennungsverfahren nach Anspruch 1, dadurch gekennzelchnet, dass der Schritt c) erst nach einer 
Zeit ausgefiihrt wird, wenn der Schritt b) den KandidatenBildteil gefunden hat. 

Farbbilderkennungsverfahren nach Anspruch 1 Oder 2, bel welchem der Schritt b) die folgenden Schritte umfasst: 

ba) (SI 02) ein umschreibendes Rechteck wird von einem Eingangs-Zweiton-Bildsignal bestimmt; 
das umschrelbende Rechteck 1st ein Rechteck, das ein Blldtell umschreibt, das aus kontinuieriichen Pixein 
besteht, wobei jedes der Pixel ein Pixel eines voriDestimmten gleichen Tons ist; 

bb) (8102) Kontaktpositionen werden detektiert, bei denen das umschrelbende Rechteck in Kontakt mit dem 
Bildteil kommt; und 

be) (8106. S107, 8108, 8115, 8116) es wird bestimmt, ob der Bildteil mit einem gegebenen Objekt Identisch 
ist Oder nicht, wobei die Bestlmmung durchgefiihrt wird, indem die Kontaktpositionen verwendet werden. 

Farbbilderkennungsverfahren nach Anspmch 3, dadurch gekennzelchnet, dass das gegebene Objekt eine recht- 
eckige Fonn hat, wobei die rechtecklge Fomi des gegebenen Objekts vorbestimmte Langen von Seiten davon 
aufweist; und 

der Schritt be) folgende Schritte umfasst: 

bc-1 ) (81 06, 81 07) basierend auf einer Annahme, das der Bildteil eine rechteckige Form hat, werden Langen 
von Seiten der rechteckigen Forni des Bildteils bestimmt; 

bc-2) (81 08) die Langen der Seiten der rechteckigen Form des Bildteiles werden mit den vorbestlmmten Lan- 
gen der Seiten der rechteckigen Fonn der Objekte verglichen und 
bc-3) (8115,811 6) es wird bestimmt, ob oder ob nicht der Bildteil mit dem gegebenen Objekt identisch Ist und 
zwar basierend auf einem Ergebnis des Vergleichs, der durch den Schritt bc2) durchgefuhrl wird. 

5. Farbbilderkennungsverfahren nach Anspruch 4, dadurch gekennzelchnet, dass: der Schritt b) welter den Schritt 
so umfasst, wonach 

bd) (81 05) bestimmt wird, ob oder ob nicht der Blldtell ein Bildteil Ist, der als ein Ergebnis des Drehens der recht- 
eckigen Fonn des Objekts erhalten worden ist; 
und wobei: 

der Schritt bc-1) geeignet Langen von Seiten der rechteckigen Forni des Bildteils bestimmen kann, wobei ein 
55 Bestimmungsergebnis verwendet wird. das durch den Schritt bd) gegeben Ist. 

6. Farbbilderkennungsverfahren nach Anspruch 3. dadurch gekennzelchnet, dass: der Schritt b) weiter folgende 
Schritte umfasst: 
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be-1) (S101) ein erstes des Eingangs-Zweiton-Bildsignals von einem Eingangs-Farbblldsignal wird in einer 
ersten Art und Weise als ein Ergebnls des Vergleichens eines Helligkeitswertes, der durch das Eingangs- 
Bildsignal dargestellt wird, mit einem ersten Schwellenwert erzielt; 

be-2) (S101) ein zweites des Eingangs-Zweiton-Biidsignal wird von dem Eingang-Farbbildsignai in einer zwel- 
5 ten Art und Welse als ein Ergebnis des Vergleichens des Helligkeitswertes, der durch das Eingabe-Farbbild- 

signal dargestellt wird, mit einem zweiten Schwellenwert, erzielt; 

und wobei der Schritt ba) ein erstes des umschreibenden Rechtecks von dem ersten des Eingangs-Zweiton- 
Bildsignals bestlmmt und ein zweites von dem umschreibenden Rechteck von dem zweiten des Eingangs- 
Zweiton-Blldsignals bestlmmt. 

10 

7. Objekt Extraktlonsverfahren nach Anspruch 6, dadurch gekennzeichnet, dass: der Schritt b) welter die Schritte 
umfasst, wonach bf) bestimmt wird, ob oder ob nicht das erste des umschreibenden Rechtecks geometrlsch voll- 
stdndig das zweite des umschreibenden Rechtecks enthalt und bestimmt wird, ob oder ob nicht das zweite des 
umschreibenden Rechtecks geometrisch vollstandig das erste des umschreibenden Rechtecks enthalt; und 

IS be) ein gewisses des ersten und zweiten umschreibenden Rechtecks wird ausgehend von einem Durchmachen 
der Schritte bb) und be) entfernt, falls der Schritt bf) bestimmt hat, dass das gewlsse geometrlsch vollstandig ein 
verbliebenes des ersten und zweiten der umschreibenden Rechtecke enthalt. 

8. Farbbilderkennungsverfahren nach Anspruch 1 . dadurch gekennzeichnet, dass: ein Schritt a) die Unterschritte 
20 umfasst, wonach 

a1) (S201) ein EIngangs-Farbbild wird in kleine Bereiche unterteilt; 

a2) (S202A) Charakteristiken werden von den kleinen Bereichen des Eingangs-Farbbildslgnals extrahiert; 

25 ein Schritt c) umfasst die Unterschritte, wonach: 

c1) (S204) eine Referenz-Charakteristlksammlung aus einer Vielzahl von Referenz-Charakteristiksammlun- 
gen fur jede der kleinen Bereiche ausgewahit wird, so dass die somit ausgewdhlte Referenz-Charakteristlk- 
sammlung Charakteristiken aufweist, die den hochsten Grad an Ahniichkeit mit den Charakteristiken haben, 
30 die von jedem der kleinen Bereiche extrahiert werden; 

wobei jede der Vielzahl von Referenz-Charakteristiksammlungen eine Identifikationsnummer aufweist und 
somit die Identifikationsnummer der somit ausgewahlten Referenz-Charakteristiksammlung zu jedem der klei- 
nen Bereiche gegeben wird; und 

c2) (S205) ein Objekt wird unter der Vielzahl von moglichen Objekten als relevant ausgewahit, so dass: 

35 

das somit ausgewahlte Objekt vorab in kleine Bereiche unterteilt wird, 

die Identifikationsnummer einer Referenz-Charakteristiksammlung unter der Vielzahl von Referenz-Cha- 
rakteristiksammlungen wird vorab zu jedem der kleinen Bereiche des somit ausgewahlten Objekts gege- 
ben und 

^0 Charakteristiken eInes Satzes der Identifikationsnummer, die zu den kleinen Bereichen der somit ausge- 

wahlten Objekte gegeben wurden, haben den hochsten Grad an Ahniichkeit zu Charakteristiken eines 
Satzes der Identifikationsnummern, die dem somit ausgewahlten Objekt entsprechen. 

9. Farbbilderkennungsverfahren nach Anspruch 8, dadurch gekennzeichnet, dass der Schritt a2} folgende Schritte 
45 umfasst: 

a2-1) Pixel werden ausgehend von Pixel abgetastet, die jeden der kleinen Bereiche bllden, die das EIngangs- 
Farbbild bilden, und 

b2) Bilddaten der somit abgetasteten Pixel werden verwendet, um die Charakteristiken von den kleinen Be- 
so reichen zu extrahieren. 

10. Farbbilderkennungsverfahren nach Anspruch 8, dadurch gekennzeichnet, dass das Verfahren weiter einen 
Schritt umfasst, wonach 

S5 a) die Charakteristiken, die durch den Schritt a2) extrahiert worden sind, konvertiert werden, so dass eine 

Datenmenge der Charakteristiken reduziert wird. 

1 1 . Farbbilderkennungsverfahren nach Anspruch 8, dadurch gekennzeichnet, dass: das Verfahren weiter die Schrit- 
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te umfasst, wonach: 



20 
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f) ein Wert fur jedes der Vielzahl von Objekten erhalten wird, wobei der Wert darstelll. wie die Referenz-Cha- 
rakteristiksammlungen, die fur die kleinen Bereiche eines jeden der Vielzahl von Objekten gegeben sind, den 
Referenz-Charakteristiksammlungen ahnlich sind, die fur die kleinen Bereiche des EIngangs-Farbbllds geqe- 
ben sind! und ^ 



g) der Wert, der durch den Schritt f) erhalten wird, wird mit einem Schwellenwert verglichen, urn so zu bestim- 
men, ob Oder ob nicht jedes der Vielzahl von Objekten ein Kandidat der Objekte unter der Vielzahl von Objekten 
ist. wobel der Kandidat der Objekte jener ist, von denen jeder eine l^dglfehkeit hat, als identlsch mit dem 
EIngangs-Farbbild bestimmt zu werden . 

12. Farbbilderkennungsverfahren nach Anspruch 11, dadurch gekennzelchnet, dass: der Schwellenwert, der im 
Schritt g) verwendet worden ist, indivlduell fQr jeden der Vielzahl von Objekten basierend auf Merkmalen der Viel- 
zahl von Objekten bestimmt wird. 

15 

13. Farbbilderkennungsverfahren nach Anspruch 8, bei welchem eIne Art und Welse des Schrittes c1 ) unter den klei- 
nen Bereichen variiert, die das Eingangsfarbbild bilden. und zwar in Abhangigkeit von den Charakteristiken, die 
durch den Schritt a2) fur jeden der kleinen Bereiche extrahlert wenjen, die das Eingangsfarbbild bilden. 

14. Farbbilderkennungsverfahren nachAnspruch 8. dadurch gekennzeichnet, dass: eine jededercharakteristischen 
Sammlungen ein Histogramm von Erscheinungshauflgkeiten umfasst, wobei die Identtfikationsnummem der cha- 
rakteristischen Sammlungen unter den charakteristischen Sammlungen zu kleinen Beretehen des Eingangsfarb- 
bildes und der Vielzahl von Objekten gegeben werden, wobei jede der Erscheinungsfrequenzen eine Erschej- 
nungsfrequenz von Pixein ist, die dieselben Charakteristiken aufweisen. 

15. Fari3bilderkennungsverfahren nach Anspruch 1 4, dadurch gekennzelchnet, dass: die Charakteristiken. die durch 
den Schritt a2) extrahlert werden, Chromazitaten bzw. Farbart und FarbsSttigung umfassen. 

16. Farbbilderkennungsverfahren nach Anspruch 14. dadurch gekennzelchnet, dass: das Verfahren welter den 
30 Schritt umfasst, wonach h) der Schritt c1 ) daran gehindert wird, ausgefiihrt zu werden, falls die Erscheinungshau- 

figkeit des Histogramms eines kleinen Berelchs unter den kleinen Bereichen, die das Eingangs-Farbblld bilden, 
einen voriDestimmten Wert iiberschreitet. 



17. Farbbilderkennungsverfahren nach Anspruch 16. dadurch gekennzeichnet, dass das Verfahren weiter den 
Schritt umfasst, wonach i) eine vorbestimmte Nummer bzw. Zahl dem kleinen Bereich gegeben bzw. zugewiesen 
wird, wobei dessen Erscheinungshaufigkeit den vorbestimmten Wert im Schritt h) uberschreitet. 

18. Farbbilderkennungsverfahren nach Anspruch 14, dadurch gekennzeichnet, dass: 

das Verfahren weiter einen Schritt umfasst, wonach 



j) der Schritt c1) an einer Ausfuhrung gehindert wird, falls nur eine Zahl von Erscheinungshaufigkelten 
unter den Erscheinungshaufigkelten, die das Histogramm eines kleinen Berelchs unter den kleinen Be- 
reichen bilden, die das Eingangs-Faribbild bilden, signifikante Werte haben, 

wobei die Zahl der Erscheinungsfrequenzen. die charakteristische sind, elnander annahern und die Zahl 
kleiner als ein Schwellenwert ist. 



19. FariDbilderkennungsverfahren nach Anspruch 18, dadurch gekennzeichnet, dass: das Verfahren weiter den 
Schritt umfasst, wonach 

50 

k) eine vortjestimmte Zahl dem kleinen Bereich gegeben wird. wobei der Schritt j) veriiindert hat, das der 
Schritt c1) fur den kleinen Bereich ausgefuhrt wird. 

20. Farbbilderkennungsverfahren nach Anspruch 8, dadurch gekennzeichnet, dass: das Verfahren weiter den Schritt 
55 umfasst, wonach 



I) der Schritt cl) an einer Ausfuhrung gehindert wird, fails die Charakteristiken einer jeden Referenz-Charakte- 
ristiksammlung unter der Vielzahl von Referenz-Charakteristiksammlungen eine Ahnlichkeit zu den Charak- 
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teristiken hat, die von jedem der kleinen Berelch extrahiert werden, wobei die Ahnlichkelt eine solche ist, die 
kleiner als ein vorbestimmter Grad bzw. vorbestimmter Umfang ist; und 

m) eine vorbestimmte Anzahl des kleinen Bereichs gegeben wird. wobel der Schritt I) verhindert hat, dass der 
Schritt cl) fur den kleinen Beretch ausgefOhrt wird. 

5 

21. Farbbitderkennungsverfahren nach Anspruch 8, dadurch gekennzetchnet, dass: der Schritt c2) das Objekt aus 
der Vielzahl von Objekten derartig auswahit, dass: 
das somit ausgewShlte Objekt vorab in kleine Bereiche unterteilt wird; 

10 wobei die Identifikationsnummer einerReferenz-Charakteristiksammlungunter der Vielzahl von Referenz-Cha- 

rakteristiksammlungen vorab einem jeden der kieinen Bereiche des somit ausgewahften Objekts zugewiesen 

wird, 

wobei ein Histogramm eines Satzes von Identifikationsnumnnern, die zu den kleinen Bereichen des somit 
ausgewahlten Objekts zugewiesen wurden, den hochsten Grad von Ahnllchkeit zu einem Histogramm eines 
'5 Satzes der Identiflkationsnummem haben, die den somit ausgewahlten Objekt entsprechen: 

wobei jedes der Histogramme ein Histogramm von Erscheinungshaufigkeiten aufweist, 
wobei die Erscheinungshaufigkeiten eine Erscheinungshdufigkeit der kieinen Bereiche sind. diedieselbe Iden- 
tifikationsnummer aufweisen. 

20 22. Farbbilderkennungsapparat, dadurch gekennzelchnet, dass: der Apparat foigendes umfasst: 

eine Einrichtung (37) zum Extrahieren von Charakterlstiken von dem Eingangs-Farbbildsignal; 
eine Einrichtung (22), urn einen Kandidatenbildteil zu finden, der einer Vielzahi von mdglichen Objekten von 
einem Eingangs-Farbbild entspricht, das durch das Eingangs-Fartbildsignal dargestelltwird, und zwar parallel 
2s zu der Extrahiereinrichtung mitteis einer Objekt-Extrahiereinrichtung; und 

eine Einrichtung (41), urn eines der Vielzahl von mogllchen Objekten als relevant auszuwahlen, indem die 
extrahierten Charakterlstiken verwendet werden, die dem Kandidatenbildteil entsprechen. 

23. Farbbilderkennungsapparat nach Anspruch 22, dadurch gekennzelchnet, dass: die Einrichtung (22) zum Finden 
30 eines Kandldatenbildtelfs foigendes umfasst: 

eine Einrichtung (2), urn ein umschreibendes Rechteck von einem Elngangs-Zweiton-Biidsignal zu bestimmen; 
wobei das umschreibende Rechteck ein Rechteck ist, das ein Bildteil umschreibt, das aus kontinuieriichen 
Pixein besteht, wobei jedes Pixel ein Pixel eines vorbestimmten gleichen Tons ist; 
35 eine Einrichtung (2), um Kontaktpositionen zu detektieren, bei denen das umschreibende Rechteck in Kontakt 

mit dem Bildteil kommt; und 

eine Einrichtung (4), um zu bestimmen, ob oder ob nicht das Bildteil mit einem gegebenen Objekt Identisch 
ist, wobei die Bestimmung durchgefOhrt wird, indem die Kontaktposition verwendet werden. 

40 24. Farbbilderkennungsapparat nach Anspruch 22, dadurch gekennzelchnet, dass: die Einrichtung zum Extrahieren 

foigendes umfasst: 

eine Einrichtung (36), um ein Eingangs-Farbbild in kleine Bereiche zu unterteilen; 
eine Einrtehtung (37), um Charakterlstiken von den kleinen Bereichen zu extrahieren; 

45 

wobei die Einrichtung zum Auswahlen foigendes umfasst: 

eine Einrichtung (38), um eine Referenz-Charakteristiksammlung aus einer Vielzahl von Referenz-Charakte- 
ristiksammiungen fur jede der kleinen Bereiche auszuwahlen, so dass die somit ausgewahlte Referenz-Cha- 
50 rakteristlksammlung Charakteristiken aufweist, die den hochsten Grad an Ahnibhkeit mit den Charakterlstiken 

aufweisen, die von jedem der kleinen Bereiche ausgewahit worden sind; 

wobei jede der Vielzahl von Referenz-Charakteristiksammiungen eine Identifikationsnummer aufweisen und somit 
die Identifikationsnummer der somit ausgewahlten Referenz-Charakteristiksammlung zu jedem der kleinen Berei- 
S5 Che zugewiesen wird; und 

eine Einrichtung (41), um ein Objekt aus einer Vielzahl von Objekten als relevant auszuwahlen, so dass 
das somit ausgewahlte Objekt vorab in kleine Bereiche unterteilt worden ist. 
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die Identifikationsnummer einer Referenz-Charakteristiksammlung unter der Vielzahl von Referenz-Charakte- 
ristlksammlungen vorab zu jedem der kleinen Berelche des somit ausgewahlten Objekts zugewiesen wurde. 
Charakteristiken eines Satzes der Identifikationsnummern, die den kleinen Bereichen des somit ausgewahlten 
Objekts zugewiesen warden, den hochsten Grad an Ahnlichkeit mit Charakteristiken eines Satzes von den 
Identifikationsnummern haben, die dem somit ausgewahlten Objekt entsprechen. 



Revendications 

1 . Proc6d6 de reconnaissance d'images en couleurs, caracterlse en ce que: 
ledit procM6 comprend les stapes consistant 

a) (S202A, S202B) extraire des caract6ristiques d'un signal d'image en couleurs d'entr§e; 

b) (S1 01 k S1 08) trouver une partie d' image candidate con-espondant h une plurality d'objets possibles k partir 
d'une image en couleur d'entrfie representee par ledit signal d'image en couleurs d'entrSe, en parallfele avec 
retape a) a I'aide d'un precede d'extraction d'objets; et 

c) (S205) seiectionner i'un de ladite plurality d'objets possibles comme important en utilisant lesdites carac- 
teristiques extraltes, qui correspondent d la partie d'image candidate. 

2. Precede de reconnaissance d'images en couleurs selon la revendication 1 , caractdrtse en ce que: 

ladite etape c) est ex6cut6e uniquement aprfes Tinstant oCj ladite etape b) a trouve ladite partie d'image can- 
didate. 

3. Precede de reconnaissance d'images en couleurs selon la revendication 1 ou 2, selon lequel ladite etape b) inclut 
les etapes consistant k: 

ba) (S102) determiner un rectangle d'encadrement k partir d'un signal d'image d'entree deux teintes; ledit 
rectangle d'encadrement etant un rectangle entourant une partie de I'image qui comprend des pixels continus, 
chacun desdits pixels etant un pixel d'une meme teinte predetermlnee; 

(bb) (S102) detecter des positions de contact au niveau desquelles ledit rectangle d'encadrement vient en 
contact avec ladite partie d'image; et 

(be) (S1 06. S1 07, S1 08. S1 1 5. S1 1 6) determiner si ladite partie d'image est identique ou non k un objet donne, 
la determination etant executee en utilisant lesdites positions de contact. 

4. Precede de reconnaissance d'images en couleurs selon la revendication 3, caracterlse en ce que: 

ledit objet donn6 possede une fomne rectangulaire, ladite forme rectangulaire dudit objet donn6 possedant 
des c6tes ayant des longueurs pr6determinees; et 
ladite etape be) comprend les etapes consistant k: 

be-1 ) (S1 06, S1 07) detemlner sur la base d'une hypothdse selon laquelle ladite partie d'image possede 
une fomie rectangulaire, la longueur des cotes de ladite forme rectangulaire de ladrte partie d'image; 
bc-2) (S1 08) comparer lesdites longueurs de c6tes de ladite fomie rectangulaire de ladite partie d'image 
auxdites longueurs pr6detemriinees de cdtes de ladite fonne rectangulaire desdits objets, et 
bc-3) (S115, S11 6) determiner si ladite partie d'image est identique ou non audit objet donne, sur la base 
d'un resullat de la comparaison executee avec ladite etape bc-2). 

G. Precede de reconnaissance d'images en couleurs selon la revendication 4, caracterlse en ce que: 

ladite etape b) comprend en outre une etape consistant a 

bd) (SI 05) determiner si ladite partie d'image est ou non une partie d'image obtenue en tant que resultat de 
la rotation de ladite forme rectangulaire dudit objet; et selon lequel: 

ladite etape bc-1 ) peut detemiiner correctement des longueurs de cote de ladite fonne rectangulaire de 
la partie d'image en utilisant un resultat de detemilnatlon obtenu lors de ladite etape bd). 

6, Precede de reconnaissance d'images en couleurs selon la revendication 3. caracterlse en ce que: 
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ladite 6tape b) comprend en outre les 6tapes consistant ^: 

be-1) (S101) obtenir un premier signal parmi tesdits signaux d'image d'entree a deux teintes a partir d'un 
signal d'image en couleurs d'entree. d'une premiere mani^re, en tant que r^sultat de la comparaison de 
la valeur de luminosity representee par ledit signal d'image en couleurs d'entree k une premiere valeur 
de seuil; 

be-2) (S1 01) obtenir un second signal parmi lesdits signaux d'image d'entree k deux teintes k partir dudit 
signal d'image en couleurs d'entree, d'une seconde mani6re, en tant que r^sultat de la comparaison de 
ladite valeur de luminosity representee par ledit signal d'image en couleurs d'entree k une premiere valeur 

de seuil; et 

selon lequel ladite 6tape ba) detemriine un premier rectangle parmi lesdits rectangles d'encadrement ^ 
partir dudit premier signal pamni lesdits signaux d'images d'entree k deux teintes, et detemriiner un second 
rectangle pamrii lesdits rectangles d'encadrement k partir dudit second signal parmi lesdits signaux d'ima- 
ges d'entree k deux teintes. 

Proc^dy d'extraction d'objets selon la revendication 6, caracterlse en ce que: 
ladite etape b) comprend en outre les stapes consistant k: 

bf) detenniner si ledit premier panni lesdits rectangles d'encadrement inclut completement ou non du point 
de vue geometrique ledit second rectangle parnii lesdits rectangles d'encadrement, et determiner si ledit se- 
cond rectangle parmi lesdits rectangles d'encadrement inclut compl6tement ou non du point de vue geome- 
trique ledit premier rectangle parmi lesdits rectangles d'encadrement; et 

bg) ellminer I'un desdits premier et second rectangles d'encadrement k partir de la mise en oeuvre desdites 
etapes bb) et be), si ladite 6tape bf) a 6tabli que ledit rectangle d'encadrement inclut complfetement, du point 
de vue gdometrique, I'un restant desdits premier et second rectangles d'encadrement. 

Precede de reconnaissance d'images en couleurs selon la revendication 1 , caracterlse en ce que: 
une etape a) comprend deux etapes consistant k 

a1) (S201) diviser une image en couleurs d'entree en de petites regions; 

a2) (S202A) extraire des caractehstiques k partir desdites petites regions dudit signal d'image en couleurs 

d'entree, 

une etape c) comprend deux etapes consistant a: 

c1) (S204) seiectionner un ensemble de caracteristiques de reference par une pluratite d'ensembles de ca- 
racterlstiques de reference pour chacune desdites petites regions de telle sorte que ledit ensemble de carac- 
teristiques de reference ainsi s^ lectionne possede des caracteristiques possedant le degre de similitude maxi- 
mum pour lesdites caracteristiques extraites de chacune desdites petites regions; 

cliacun de ladite pluratite d'ensembles de caracteristiques de reference possede un numero d'identification 
et par consequent le numero d'identification de I'ensemble de caracteristiques de reference ainsi seiectionne 
est fourni pourciiacune desdites petites regions; et 

c2) (S205) seiectionner un objet pamni ladite pluralite d'objets possibles comme etant important de telle sorte 
que: 

I'objet ainsi seiectionne est divise prealablement en les petites regions, 

le numero d'identification d'un ensemble de caracteristiques de reference de ladite plurality d'ensemble 
de caracteristiques de reference est donne prealablement a chacune desdites petites regions dudit objet 
ainsi seiectionne, et 

des caracteristiques d'un ensemble des numeros d'identification prevus pour lesdites petites regions dudit 
objet ainsi seiectionne possedent le degre maximum de similitude avec des caracteristiques d'un ensem- 
ble des numeros d'identification correspondant a I'objet ainsi seiectionne. 

Precede de reconnaissance d'images en couleurs selon la revendication 8, caracterlse en ce que: 
ladite ytape a2) comprend les etapes consistant k: 

a2-1) echantillonner des pixels parmi des pixels constituent chacune desdites petites regions qui constituent 
I'image en couleurs d'entree, et 

b-2) utiliser des donnees d'images des pixels ainsi echantillonnes pour extraire lesdites caracteristiques des- 
dites petites regions. 
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10. Proc6d6 de reconnaissance d'images en couleurs selon la revendication 8, caracterise en ce que* 
ledit proc6d6 comprend en outre une ^tape consistant k\ 

e) convertir lesdites caract§ristiques. qui ont et6 extraites par tadite Stapes a2), de telle sorte qu'une valeur 
de date desdites caract6ristlques est r6dutte. 

11. Procede de reconnaissance d'images selon la revendication 8, caracterise en ce que: 
ledit procedd comprend en outre les 6tapes consistant 6: 

f) obtenir une valeur pour chacun de ladite plurality d'objets, ladlte valeur repr6sentant la manifere dont les 
ensembles de caract6ristiques de r6f6rence donnes auxdites petites regions de chacun de ladrte plurality 
d objets est similaire aux ensembles de caract6ristlques de r6f6rence donnes auxdites petites rSglons de ladite 
image en couleurs d'entr6e; et 

g) comparer ladite valeur obtenue au moyen de I'^tape f) a une valeur de seuil de manidre k determiner si 
chacun de ladite plurality d'objets est un candidal d'objets parmi ladite plurality d'objets. ledit candidal d'objets 
etant forme par les objets qui presentent une possibilite d'dtre detenminds comme identlques ^ ladite imaqe 
en couleurs d'entr^e. ^ 

12. Proc6d6 de reconnaissance d'images en couleurs selon la revendication 11 , caracterise en ce que ladite valeur 
de seuil utilisee lors de ladite 6tape g) est detemiinee individuellement pour chacun de ladite pluralit6 d'objets sur 
la base de caract6risttques de ladite pluralite d'objets. 

13. Procede de reconnaissance d'images en couleurs selon la revendication 8. selon lequel un mode intervenant loi^ 
de ladite 6tape c1) varie entre lesdites petites regions constituant ladite image en couleurs d'entrde. en fonctlon 
des caract6ristiques extraites au moyen de ladite ^tape a2) pour chacune desdites petites regions constituant 
ladite image en couleurs d'entr6e. 

14. Proc6d6 de connaissance d'images en couleur selon la revendication 8. caracterise en ce que- 

chacun des ensembles de caracteristiques comprend un histogramme de frequences d'apparition. les numdros 
d Identification d'ensembles de caract6ristiques parmi lesdits ensembles de caract6ristiques etant donnes aux 
petites regions de ladite image en couleurs d'entree et k ladite plurality d'objets. chacune desdites frequences 
d appantion etant une frequence d'apparition de pixels ayant les memes caracteristiques. 

15. Procede de reconnaissance d'images en couleurs selon la revendication 14, caracterise en ce que- 
lesdites caracteristiques extraites lors de ladite 6tape a2) comprennent des chromaticit6s. 

16. Precede de reconnaissance d'images en couleurs selon la revendication 14. caracterise en ce que' 
ledit precede comprend en outre une etape consistant k 

h) emp§cher {'execution de ladite etape c1 ), si la frequence d'apparition de I'histogramme d'une petite region 
parnii lesdites petites regions constituant ladite image en couleurs d'entree depasse une valeur predetermlnee. 

1 7. Precede de reconnaissance d'images en couleurs selon ia revendication 1 6. caracterise en ce que- 
ledit precede comprend en outre une etape consistant k 

I) donner un numero predetemiine k ladite petite region, dont ladite frequence d'apparition depasse ladite 
valeur predetemilnee lors de ladite etape h). 

18. Precede de reconnaissance d'images en couleurs selon la revendication 14, caracterise en ce que* 
ledit precede comprend en outre une etape consistant k 

j) empecher I'execution de ladite etape c1 ) si seul un nombre de frequences d'apparition parmi les frequences 
d appantion constituant Thistogramme d'une petite region pamii lesdites petites regions constituant ladite ima- 
ge en couleurs d'entree possedent des valeurs significatives, 

ledit nombre de frequences d'apparition etant les frequences' des caracteristiques qui sent voisines les unes 
des autres, lesdits nombres etant inf6rieurs k ladite valeur de seuil. 

19. Precede de reconnaissance d'images en couleur selon la revendication 1 8, caracterise en ce que: 
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ledit proc^dd comprend en outre une dtape consistant ^: 

k) donner un numero predetermine d ladite petite region, ladite Stape j) ayant emp§cher I'ex^ution de ladite 
6tape c1 ) pour ladite petite region. 

5 

20. Precede de reconnaissance d'images en couleurs selon la revendlcation 8, caracterise en ce que: 
ledit proc6d6 comprend en outre une dtape consistant k: 

I) empecher I'execution de ladite etape c1) 

si lea caract6ristlques de chaque ensemble de caract6ristiques de r6f6rence pamni ladite plurality tf ensembles 
decaractdristiques de reference pr6sententdes similitudes avec lesdites caract6ristiques extraites dechacune 
desdites petltes regions, ladite similitude ^tant infSrIeure ^ un degrd preddtennlnS; et 
m) donner un numdro pr^ddtennind k ladite petite r^ion, ladite dtape 1 ) ayant empecher I'exdcutlon de ladite 
dtape c1) pour ladite petite rdgion. 

15 

21. Precede de reconnaissance d'images en couleurs selon la revendlcation 8, caracterise en ce que: 
ladite etape c2) selectionne I'objet parmi ladite plurality d'objets de telle sorte que: 

Tobjet ainsi selectionne est divise pr6alablement en les petites regions; 
20 le num6ro d' Identification d'un ensemble de caract6ristlques de reference parmI ladite plurallte d'ensembles 

de caracteristlques de reference ayant ete prdalablement donne h chacune desdites petites regions dudit 
objet aInsi s6lectionn6, 

un histogramme d'un ensemble des numeros d'identification donnes auxdites petites regions dudit objet aInsI 
s^lectionnd poss^dant le degre maximum de similitude avec un histogramme d'un ensemble des numeros 
25 ^Identification correspondant k I'objet ainsI s6lectlonn6; 

chacun des histogrammes comprenant un histogramme de frequences d'apparition, chacune desdites fre- 
quences d'apparitton etant une frequence d'apparition des petites regions et ayant le m&me num6ro d'identi- 
fication. 

30 22. Dispositif de reconnaissance d'images en couleurs caracterise en ce que: 
ledit dispositif comprend: ' 

des moyens (37) pour exlraire des caracteristlques d'un signal d'Image en couleurs d'entr§e; 
des moyens (22) pourtrouver une partie d'Image candidate correspondant k une plurality d'objets possibles 
^5 k partir d'une image en couleurs d'entrde representee par ledit signal d'Image en couleurs d'entree, en parallfele 

avec lesdits moyens d'extractlon a I'aide de moyens d'extraction d'objets; et 

des moyens (41 ) pour selectionner Tun de ladite pluralite d'objets possibles comme Important moyennant 
I'utilisation desdites caracteristlques extraites qui con^espondent k la partie d'Image candidate. 

40 23. Dispositif de reconnaissance d'image en couleurs selon la revendlcation 22, caracterise en ce que: 
lesdits moyens (22) pour fixer une partie d'image candidate comprennent: 

des moyens (2) pour determiner un rectangle d'encadrement k partir d'un signal d'Image d'entree k deux 
telntes; 

^5 ledit rectangle d'encadrement etant un rectangle encadrant une partie d'image qui est constituee de pixels 

continus, chacun desdits pixels etant un pixel ayant une mdme telnte predetemiinee; 
des moyens (2) pour detecter des positions de contact, dans lesquelles ledit rectangle d'encadrement vient 
en contact avec ladite partie d'Image; et 

des moyens (4) pour detemiiner si ladite partie d'Image est identlque ou non k un objet donne, ladite deter- 
5" minatlon etant ex6cutee en utillsant lesdites parties de contact. 

24. Dispositif de reconnaissance d'images en couleurs selon la revendlcation 22, caracterise en ce que: 
lesdits moyens d'extraction comprennent: 

5^ des moyens (36) pour divlser une image d'entree en couleurs en petites regions; 

des moyens (37) pour extraire des caracteristlques k partir desdites petites regions; 
lesdits moyens de selection comprennent: 
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des moyens (38) pour s6lectionner un ensemble de caract6rlstlques de r6f6rence parmi une pluralite 
d'ensembles de caracteristiques de reference pour chacune desdites petites regions, de telle sorte que 
I'ensemble ainsi selectionne de caracteristiques de reference possede des caracteristiques presentant le 
degre maxinnal de similitude avec lesdites caracteristiques extraites de chacune desdites petites regions- 
chacun de ladite pluralit6 d'ensembles de caracteristiques de r6f6rence possedant un num6ro d'identifi- 
cation, et ainsi le num6ro ^identification de I'ensemble ainsi s6lectlonn6 de caracteristiques de reference 
est donn6 k chacune desdites petites regions; et 

des moyens (41) pour s6lectionner un objet parmi ladite pluralite d'objets en tant qu'important. de telle 
sorte que: 



I'objet ainsi s6lectlonn6 6tant pr^aiablement divls6 en les petites regions, 

le num6ro d'identiflcatlon d'un ensemble de caracteristiques de reference parmi ladite pluralite d'en- 
sembles de caracteristiques de reference etant precedemment fixe pour chacune desdites petites 
regions dudit objet ainsi selectionne. 

des caracteristiques d'un ensemble des numeros d'identlflcation donne pour lesdites petites regions 
dudit objet ainsi selectionne possedant le degre maximum de similitude avec des caracteristiques 
d'un ensemble des numeros d'identlflcation correspondant k I'objet ainsi selectionne. 
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